================================================================================ SUMMARY: +--------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------+--------+----------+---------+----------+-------+-----------+ | 03:AGGREGATE | 1 | 43.55ms | 0ns | 43.55ms | 1 | 1 | | 02:EXCHANGE | 1 | 157.64us | 0ns | 157.64us | 15 | 1 | | 01:AGGREGATE | 15 | 280.44ms | 0ns | 352.48ms | 15 | 1 | | 00:SCAN HDFS | 15 | 988.07ms | 0ns | 1.17s | 1.80B | 180.00M | +--------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=3a46f58658206e67:2d280fcc00000000): Summary: Session ID: f949d06830582cc9:6e9f41a6bf30998d Session Type: BEESWAX Start Time: 2016-08-24 04:24:52.083200000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.7.0-cdh5-INTERNAL RELEASE (build f25891b0baf667b44941a157e78aaece61a2421c) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:56902 Default Db: tpch_300_parquet Sql Statement: -- Description : Scan fact table while applying non-selective filter on bigint column. -- Target test case : Basic scan and filter. SELECT count(*) FROM lineitem WHERE l_orderkey > 20 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=98.00MB VCores=1 03:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 01:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=1 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_orderkey > 20 table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=179998909 ---------------- Estimated Per-Host Mem: 102760448 Estimated Per-Host VCores: 1 Request Pool: default-pool Planner Timeline: 4.653ms - Analysis finished: 1.490ms (1.490ms) - Equivalence classes computed: 1.597ms (107.244us) - Single node plan created: 2.503ms (906.296us) - Runtime filters computed: 2.537ms (33.725us) - Distributed plan created: 2.967ms (430.496us) - Lineage info computed: 3.559ms (591.158us) - Planning finished: 4.653ms (1.094ms) Query Timeline: 1s600ms - Start execution: 37.206us (37.206us) - Planning finished: 6.652ms (6.615ms) - Ready to start 15 remote fragments: 51.089ms (44.436ms) - All 15 remote fragments started: 134.164ms (83.074ms) - Rows available: 1s590ms (1s456ms) - First row fetched: 1s595ms (5.197ms) - ComputeScanRangeAssignmentTimer: 517.068us ImpalaServer: - ClientFetchWaitTimer: 5.430ms - RowMaterializationTimer: 8.484us Execution Profile 3a46f58658206e67:2d280fcc00000000:(Total: 1s584ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 15, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 69ms, 95th %-ile: 69ms, 99.9th %-ile: 82ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(141.33 MB) vb0222.halxg.cloudera.com:22000(137.83 MB) vb0224.halxg.cloudera.com:22000(139.33 MB) vb0220.halxg.cloudera.com:22000(141.35 MB) vb0206.halxg.cloudera.com:22000(141.39 MB) vb0228.halxg.cloudera.com:22000(141.39 MB) vb0216.halxg.cloudera.com:22000(141.33 MB) vb0232.halxg.cloudera.com:22000(141.33 MB) vb0226.halxg.cloudera.com:22000(141.33 MB) vb0234.halxg.cloudera.com:22000(139.33 MB) vb0230.halxg.cloudera.com:22000(141.33 MB) vb0208.halxg.cloudera.com:22000(137.33 MB) vb0214.halxg.cloudera.com:22000(141.33 MB) vb0212.halxg.cloudera.com:22000(141.33 MB) vb0204.halxg.cloudera.com:22000(141.34 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 1s480ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 28.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 43.373ms - RowsProduced: 0 (0) - TotalCpuTime: 151.410ms - TotalNetworkReceiveTime: 1s436ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 60.546ms, non-child: 60.546ms, % non-child: 100.00%) - CodegenTime: 641.130us - CompileTime: 3.065ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 11.943ms - PrepareTime: 44.814ms AGGREGATION_NODE (id=3):(Total: 1s480ms, non-child: 43.550ms, % non-child: 2.94%) ExecOption: Codegen Enabled - BuildTime: 63.010us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=2):(Total: 1s437ms, non-child: 157.642us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 32.00 B - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 21.782us - DeserializeRowBatchTimer: 85.340us - FirstBatchArrivalWaitTime: 1s009ms - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 10.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1s269ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 140.78 MB completion times: min:1s089ms max:1s537ms mean: 1s296ms stddev:123.372ms execution rates: min:2.86 GB/sec max:4.03 GB/sec mean:3.34 GB/sec stddev:322.39 MB/sec num instances: 15 - AverageThreadTokens: 11.22 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.57 MB (147401300) - PerHostPeakMemUsage: 140.58 MB (147403757) - PrepareTime: 46.260ms - RowsProduced: 1 (1) - TotalCpuTime: 13s459ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 323.204us - TotalStorageWaitTime: 256.869ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.411ms, non-child: 71.411ms, % non-child: 100.00%) - CodegenTime: 781.186us - CompileTime: 8.330ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.147ms - PrepareTime: 45.365ms DataStreamSender (dst_id=2):(Total: 66.748us, non-child: 66.748us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 413.46 KB/sec - OverallThroughput: 243.98 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 12.305us - TransmitDataRPCTime: 42.055us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s268ms, non-child: 280.436ms, % non-child: 22.11%) - BuildTime: 172.996ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 327.07 KB (334916) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 988.071ms, non-child: 988.071ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.18 - AverageScannerThreadConcurrency: 10.47 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s445ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.53 MB (147358974) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999271) - RowsReturnedRate: 122.75 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.18K (1177) - ScannerThreadsTotalWallClockTime: 12s420ms - MaterializeTupleTime(*): 2s500ms - ScannerThreadsSysTime: 577.373ms - ScannerThreadsUserTime: 4s958ms - ScannerThreadsVoluntaryContextSwitches: 116.40K (116398) - TotalRawHdfsReadTime(*): 142.885ms - TotalReadThroughput: 111.94 MB/sec Fragment F00: Instance 3a46f58658206e67:2d280fcc0000000e (host=vb0222.halxg.cloudera.com:22000):(Total: 1s510ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB MemoryUsage(500.000ms): 137.64 MB, 137.56 MB, 91.45 MB ThreadUsage(500.000ms): 12, 12, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.83 MB (144529184) - PerHostPeakMemUsage: 137.83 MB (144529184) - PrepareTime: 47.052ms - RowsProduced: 1 (1) - TotalCpuTime: 15s804ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 384.490us - TotalStorageWaitTime: 234.380ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.380ms, non-child: 72.380ms, % non-child: 100.00%) - CodegenTime: 791.752us - CompileTime: 8.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.259ms - PrepareTime: 46.118ms DataStreamSender (dst_id=2):(Total: 67.328us, non-child: 67.328us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 361.05 KB/sec - OverallThroughput: 232.07 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.098us - TransmitDataRPCTime: 43.276us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s509ms, non-child: 352.476ms, % non-child: 23.35%) ExecOption: Codegen Enabled - BuildTime: 215.553ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s156ms, non-child: 1s156ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 114.43 MB, 114.43 MB, 188.64 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 188.64 MB (197801280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.64 MB (197801280) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.64 MB (197801280) - DecompressionTime: 1s536ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.80 MB (144492320) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112187) - RowsReturned: 123.11M (123112187) - RowsReturnedRate: 106.42 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1381) - ScannerThreadsTotalWallClockTime: 14s501ms - MaterializeTupleTime(*): 2s684ms - ScannerThreadsSysTime: 685.890ms - ScannerThreadsUserTime: 5s401ms - ScannerThreadsVoluntaryContextSwitches: 156.23K (156233) - TotalRawHdfsReadTime(*): 143.454ms - TotalReadThroughput: 125.76 MB/sec Instance 3a46f58658206e67:2d280fcc00000007 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s466ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB MemoryUsage(500.000ms): 141.08 MB, 140.87 MB, 47.55 MB ThreadUsage(500.000ms): 12, 12, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.948ms - RowsProduced: 1 (1) - TotalCpuTime: 15s499ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 255.914us - TotalStorageWaitTime: 239.174ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.617ms, non-child: 70.617ms, % non-child: 100.00%) - CodegenTime: 689.020us - CompileTime: 7.858ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.051ms - PrepareTime: 45.190ms DataStreamSender (dst_id=2):(Total: 49.100us, non-child: 49.100us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 607.79 KB/sec - OverallThroughput: 318.23 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.986us - TransmitDataRPCTime: 25.708us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s465ms, non-child: 292.521ms, % non-child: 19.95%) ExecOption: Codegen Enabled - BuildTime: 184.743ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s173ms, non-child: 1s173ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.63 MB, 116.63 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 190.83 MB (200101412) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101412) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101412) - DecompressionTime: 1s618ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581309) - RowsReturned: 124.58M (124581309) - RowsReturnedRate: 106.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.39K (1386) - ScannerThreadsTotalWallClockTime: 14s246ms - MaterializeTupleTime(*): 2s804ms - ScannerThreadsSysTime: 650.896ms - ScannerThreadsUserTime: 5s693ms - ScannerThreadsVoluntaryContextSwitches: 124.53K (124533) - TotalRawHdfsReadTime(*): 152.965ms - TotalReadThroughput: 127.22 MB/sec Instance 3a46f58658206e67:2d280fcc0000000d (host=vb0224.halxg.cloudera.com:22000):(Total: 1s415ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(500.000ms): 138.94 MB, 139.08 MB, 48.97 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.33 MB (146093856) - PerHostPeakMemUsage: 139.33 MB (146102048) - PrepareTime: 44.304ms - RowsProduced: 1 (1) - TotalCpuTime: 15s034ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 354.872us - TotalStorageWaitTime: 265.658ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.539ms, non-child: 69.539ms, % non-child: 100.00%) - CodegenTime: 831.912us - CompileTime: 8.380ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.261ms - PrepareTime: 43.322ms DataStreamSender (dst_id=2):(Total: 56.454us, non-child: 56.454us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 486.33 KB/sec - OverallThroughput: 276.77 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.504us - TransmitDataRPCTime: 32.128us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s414ms, non-child: 283.074ms, % non-child: 20.01%) ExecOption: Codegen Enabled - BuildTime: 180.086ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s131ms, non-child: 1s131ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 115.58 MB, 115.58 MB, 115.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 189.80 MB (199018915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.80 MB (199018915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.80 MB (199018915) - DecompressionTime: 1s575ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.28 MB (146040608) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 123.88M (123876541) - RowsReturnedRate: 109.50 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1319) - ScannerThreadsTotalWallClockTime: 13s858ms - MaterializeTupleTime(*): 2s698ms - ScannerThreadsSysTime: 638.897ms - ScannerThreadsUserTime: 5s449ms - ScannerThreadsVoluntaryContextSwitches: 118.10K (118097) - TotalRawHdfsReadTime(*): 142.390ms - TotalReadThroughput: 77.05 MB/sec Instance 3a46f58658206e67:2d280fcc00000006 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s345ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB MemoryUsage(500.000ms): 140.94 MB, 141.06 MB, 61.03 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.31 MB (148174624) - PerHostPeakMemUsage: 141.34 MB (148203296) - PrepareTime: 46.093ms - RowsProduced: 1 (1) - TotalCpuTime: 14s508ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 134.836us - TotalStorageWaitTime: 247.654ms CodeGen:(Total: 71.499ms, non-child: 71.499ms, % non-child: 100.00%) - CodegenTime: 707.226us - CompileTime: 8.481ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.276ms - PrepareTime: 45.152ms DataStreamSender (dst_id=2):(Total: 51.200us, non-child: 51.200us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 710.61 KB/sec - OverallThroughput: 305.18 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.208us - TransmitDataRPCTime: 21.988us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s345ms, non-child: 271.135ms, % non-child: 20.16%) ExecOption: Codegen Enabled - BuildTime: 166.288ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s074ms, non-child: 1s074ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 117.05 MB, 117.05 MB, 127.66 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.67 MB (189441106) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.67 MB (189441106) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.67 MB (189441106) - DecompressionTime: 1s489ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.28 MB (148137760) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.79M (117791246) - RowsReturned: 117.79M (117791246) - RowsReturnedRate: 109.67 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.27K (1273) - ScannerThreadsTotalWallClockTime: 13s383ms - MaterializeTupleTime(*): 2s564ms - ScannerThreadsSysTime: 658.895ms - ScannerThreadsUserTime: 5s130ms - ScannerThreadsVoluntaryContextSwitches: 118.16K (118156) - TotalRawHdfsReadTime(*): 143.898ms - TotalReadThroughput: 85.11 MB/sec Instance 3a46f58658206e67:2d280fcc00000001 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s310ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB MemoryUsage(500.000ms): 140.86 MB, 141.00 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148191008) - PerHostPeakMemUsage: 141.33 MB (148191008) - PrepareTime: 49.927ms - RowsProduced: 1 (1) - TotalCpuTime: 14s033ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 335.392us - TotalStorageWaitTime: 264.086ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 75.183ms, non-child: 75.183ms, % non-child: 100.00%) - CodegenTime: 681.806us - CompileTime: 8.452ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.124ms - PrepareTime: 49.032ms DataStreamSender (dst_id=2):(Total: 73.092us, non-child: 73.092us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 332.54 KB/sec - OverallThroughput: 213.77 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.072us - TransmitDataRPCTime: 46.986us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s307ms, non-child: 280.496ms, % non-child: 21.46%) ExecOption: Codegen Enabled - BuildTime: 172.365ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s026ms, non-child: 1s026ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.62 MB, 116.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.24 MB (188991096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188991096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188991096) - DecompressionTime: 1s473ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.28 MB (148137760) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659771) - RowsReturned: 117.66M (117659771) - RowsReturnedRate: 114.59 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1203) - ScannerThreadsTotalWallClockTime: 12s960ms - MaterializeTupleTime(*): 2s524ms - ScannerThreadsSysTime: 614.901ms - ScannerThreadsUserTime: 5s079ms - ScannerThreadsVoluntaryContextSwitches: 116.63K (116634) - TotalRawHdfsReadTime(*): 148.251ms - TotalReadThroughput: 116.62 MB/sec Instance 3a46f58658206e67:2d280fcc00000004 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s308ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB MemoryUsage(500.000ms): 140.96 MB, 141.04 MB, 74.55 MB ThreadUsage(500.000ms): 12, 12, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.071ms - RowsProduced: 1 (1) - TotalCpuTime: 13s988ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 270.644us - TotalStorageWaitTime: 250.399ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.321ms, non-child: 70.321ms, % non-child: 100.00%) - CodegenTime: 793.210us - CompileTime: 8.390ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.153ms - PrepareTime: 44.220ms DataStreamSender (dst_id=2):(Total: 86.846us, non-child: 86.846us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 256.79 KB/sec - OverallThroughput: 179.92 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.278us - TransmitDataRPCTime: 60.846us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s307ms, non-child: 314.715ms, % non-child: 24.07%) ExecOption: Codegen Enabled - BuildTime: 193.316ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 992.814ms, non-child: 992.814ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 117.14 MB, 117.14 MB, 180.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 180.75 MB (189534707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189534707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189534707) - DecompressionTime: 1s477ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117849031) - RowsReturned: 117.85M (117849031) - RowsReturnedRate: 118.70 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1197) - ScannerThreadsTotalWallClockTime: 12s903ms - MaterializeTupleTime(*): 2s518ms - ScannerThreadsSysTime: 530.913ms - ScannerThreadsUserTime: 5s027ms - ScannerThreadsVoluntaryContextSwitches: 107.59K (107590) - TotalRawHdfsReadTime(*): 133.922ms - TotalReadThroughput: 120.50 MB/sec Instance 3a46f58658206e67:2d280fcc0000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 1s267ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB MemoryUsage(500.000ms): 56.48 MB, 140.93 MB, 61.20 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.35 MB (148215584) - PerHostPeakMemUsage: 141.35 MB (148215584) - PrepareTime: 47.408ms - RowsProduced: 1 (1) - TotalCpuTime: 13s358ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 209.208us - TotalStorageWaitTime: 277.773ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.583ms, non-child: 72.583ms, % non-child: 100.00%) - CodegenTime: 807.024us - CompileTime: 8.373ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.203ms - PrepareTime: 46.438ms DataStreamSender (dst_id=2):(Total: 57.346us, non-child: 57.346us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 486.09 KB/sec - OverallThroughput: 272.47 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.576us - TransmitDataRPCTime: 32.144us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s266ms, non-child: 263.312ms, % non-child: 20.79%) ExecOption: Codegen Enabled - BuildTime: 161.341ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 363.01 KB (371720) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s003ms, non-child: 1s003ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:0% 3:0% 4:0% 5:0% 6:33.33% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 1000.00 KB, 116.65 MB, 127.25 MB - AverageHdfsReadThreadConcurrency: 2.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 169.66 MB (177904158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177904158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177904158) - DecompressionTime: 1s367ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738860) - RowsReturned: 110.74M (110738835) - RowsReturnedRate: 110.35 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 1.16K (1164) - ScannerThreadsTotalWallClockTime: 12s342ms - MaterializeTupleTime(*): 2s343ms - ScannerThreadsSysTime: 586.906ms - ScannerThreadsUserTime: 4s729ms - ScannerThreadsVoluntaryContextSwitches: 113.91K (113906) - TotalRawHdfsReadTime(*): 139.676ms - TotalReadThroughput: 84.83 MB/sec Instance 3a46f58658206e67:2d280fcc00000005 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s255ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB MemoryUsage(500.000ms): 1.12 MB, 138.87 MB, 68.23 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.33 MB (146102048) - PerHostPeakMemUsage: 139.33 MB (146102048) - PrepareTime: 47.174ms - RowsProduced: 1 (1) - TotalCpuTime: 13s491ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 297.740us - TotalStorageWaitTime: 294.897ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.413ms, non-child: 72.413ms, % non-child: 100.00%) - CodegenTime: 818.594us - CompileTime: 8.366ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.250ms - PrepareTime: 46.213ms DataStreamSender (dst_id=2):(Total: 106.508us, non-child: 106.508us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 196.41 KB/sec - OverallThroughput: 146.70 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.068us - TransmitDataRPCTime: 79.554us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s254ms, non-child: 293.929ms, % non-child: 23.43%) ExecOption: Codegen Enabled - BuildTime: 179.079ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 960.531ms, non-child: 960.531ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:33.33% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 115.48 MB, 126.28 MB - AverageHdfsReadThreadConcurrency: 0.67 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 189.70 MB (198913222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.70 MB (198913222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.70 MB (198913222) - DecompressionTime: 1s437ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.30 MB (146065184) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123827522) - RowsReturned: 123.83M (123827522) - RowsReturnedRate: 128.92 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.17K (1173) - ScannerThreadsTotalWallClockTime: 12s504ms - MaterializeTupleTime(*): 2s468ms - ScannerThreadsSysTime: 514.914ms - ScannerThreadsUserTime: 4s928ms - ScannerThreadsVoluntaryContextSwitches: 110.41K (110408) - TotalRawHdfsReadTime(*): 154.189ms - TotalReadThroughput: 84.19 MB/sec Instance 3a46f58658206e67:2d280fcc0000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 1s234ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB MemoryUsage(500.000ms): 140.79 MB, 133.10 MB, 51.42 MB ThreadUsage(500.000ms): 12, 12, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.39 MB (148256552) - PerHostPeakMemUsage: 141.39 MB (148256552) - PrepareTime: 46.846ms - RowsProduced: 1 (1) - TotalCpuTime: 13s186ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 256.022us - TotalStorageWaitTime: 250.649ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.633ms, non-child: 71.633ms, % non-child: 100.00%) - CodegenTime: 698.862us - CompileTime: 7.915ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.806ms - PrepareTime: 46.379ms DataStreamSender (dst_id=2):(Total: 54.726us, non-child: 54.726us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 491.79 KB/sec - OverallThroughput: 285.51 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.446us - TransmitDataRPCTime: 31.772us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s233ms, non-child: 277.714ms, % non-child: 22.51%) ExecOption: Codegen Enabled - BuildTime: 167.992ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 955.929ms, non-child: 955.929ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.63 MB, 116.63 MB, 188.32 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 188.32 MB (197467446) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.32 MB (197467446) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.32 MB (197467446) - DecompressionTime: 1s453ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.34 MB (148203304) - PerReadThreadRawHdfsThroughput: 1.32 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.89M (122890709) - RowsReturned: 122.89M (122890709) - RowsReturnedRate: 128.56 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1120) - ScannerThreadsTotalWallClockTime: 12s176ms - MaterializeTupleTime(*): 2s533ms - ScannerThreadsSysTime: 559.910ms - ScannerThreadsUserTime: 4s955ms - ScannerThreadsVoluntaryContextSwitches: 114.79K (114792) - TotalRawHdfsReadTime(*): 139.381ms - TotalReadThroughput: 125.55 MB/sec Instance 3a46f58658206e67:2d280fcc00000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s215ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(500.000ms): 140.86 MB, 52.91 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.799ms - RowsProduced: 1 (1) - TotalCpuTime: 12s961ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 306.582us - TotalStorageWaitTime: 234.308ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.918ms, non-child: 70.918ms, % non-child: 100.00%) - CodegenTime: 826.590us - CompileTime: 8.347ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.139ms - PrepareTime: 44.853ms DataStreamSender (dst_id=2):(Total: 74.360us, non-child: 74.360us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 324.80 KB/sec - OverallThroughput: 210.13 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 15.120us - TransmitDataRPCTime: 48.106us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s214ms, non-child: 266.340ms, % non-child: 21.93%) ExecOption: Codegen Enabled - BuildTime: 168.341ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 947.922ms, non-child: 947.922ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 117.14 MB, 117.14 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.75 MB (189526837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189526837) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189526837) - DecompressionTime: 1s435ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852239) - RowsReturned: 117.85M (117852239) - RowsReturnedRate: 124.33 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.13K (1128) - ScannerThreadsTotalWallClockTime: 11s954ms - MaterializeTupleTime(*): 2s458ms - ScannerThreadsSysTime: 559.910ms - ScannerThreadsUserTime: 4s932ms - ScannerThreadsVoluntaryContextSwitches: 114.23K (114233) - TotalRawHdfsReadTime(*): 121.424ms - TotalReadThroughput: 117.14 MB/sec Instance 3a46f58658206e67:2d280fcc00000009 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s196ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 0, 141.12 MB, 68.98 MB ThreadUsage(500.000ms): 1, 12, 12 - AverageThreadTokens: 8.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 46.590ms - RowsProduced: 1 (1) - TotalCpuTime: 12s646ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 386.104us - TotalStorageWaitTime: 273.855ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.868ms, non-child: 71.868ms, % non-child: 100.00%) - CodegenTime: 855.552us - CompileTime: 8.424ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.207ms - PrepareTime: 45.670ms DataStreamSender (dst_id=2):(Total: 68.330us, non-child: 68.330us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 341.19 KB/sec - OverallThroughput: 228.67 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.872us - TransmitDataRPCTime: 45.796us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s195ms, non-child: 256.938ms, % non-child: 21.49%) ExecOption: Codegen Enabled - BuildTime: 158.466ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 938.489ms, non-child: 938.489ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.63 MB, 137.84 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.26 MB (189017820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.26 MB (189017820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.26 MB (189017820) - DecompressionTime: 1s444ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.11 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659823) - RowsReturned: 117.66M (117659823) - RowsReturnedRate: 125.37 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.15K (1154) - ScannerThreadsTotalWallClockTime: 11s697ms - MaterializeTupleTime(*): 2s552ms - ScannerThreadsSysTime: 566.909ms - ScannerThreadsUserTime: 4s917ms - ScannerThreadsVoluntaryContextSwitches: 105.35K (105352) - TotalRawHdfsReadTime(*): 158.813ms - TotalReadThroughput: 137.84 MB/sec Instance 3a46f58658206e67:2d280fcc0000000b (host=vb0206.halxg.cloudera.com:22000):(Total: 1s193ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(500.000ms): 141.00 MB, 133.09 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.39 MB (148256552) - PerHostPeakMemUsage: 141.39 MB (148256552) - PrepareTime: 46.408ms - RowsProduced: 1 (1) - TotalCpuTime: 12s740ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 367.471us - TotalStorageWaitTime: 281.657ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.494ms, non-child: 71.494ms, % non-child: 100.00%) - CodegenTime: 819.992us - CompileTime: 8.390ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.059ms - PrepareTime: 45.464ms DataStreamSender (dst_id=2):(Total: 68.942us, non-child: 68.942us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 325.38 KB/sec - OverallThroughput: 226.64 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.443us - TransmitDataRPCTime: 48.020us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s192ms, non-child: 292.101ms, % non-child: 24.50%) ExecOption: Codegen Enabled - BuildTime: 178.988ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 899.986ms, non-child: 899.986ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.61 MB, 116.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 190.82 MB (200088922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200088922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200088922) - DecompressionTime: 1s375ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.34 MB (148203304) - PerReadThreadRawHdfsThroughput: 1.24 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580633) - RowsReturned: 124.58M (124580633) - RowsReturnedRate: 138.43 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1113) - ScannerThreadsTotalWallClockTime: 11s803ms - MaterializeTupleTime(*): 2s376ms - ScannerThreadsSysTime: 503.918ms - ScannerThreadsUserTime: 4s653ms - ScannerThreadsVoluntaryContextSwitches: 107.78K (107782) - TotalRawHdfsReadTime(*): 150.053ms - TotalReadThroughput: 116.61 MB/sec Instance 3a46f58658206e67:2d280fcc00000002 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s180ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(500.000ms): 141.06 MB, 109.06 MB, 15.76 MB ThreadUsage(500.000ms): 12, 12, 5 - AverageThreadTokens: 9.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.177ms - RowsProduced: 1 (1) - TotalCpuTime: 12s196ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 634.014us - TotalStorageWaitTime: 250.481ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.326ms, non-child: 70.326ms, % non-child: 100.00%) - CodegenTime: 853.412us - CompileTime: 8.369ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.139ms - PrepareTime: 44.258ms DataStreamSender (dst_id=2):(Total: 57.488us, non-child: 57.488us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 456.79 KB/sec - OverallThroughput: 271.79 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.416us - TransmitDataRPCTime: 34.206us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s178ms, non-child: 271.246ms, % non-child: 23.03%) ExecOption: Codegen Enabled - BuildTime: 165.717ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 906.761ms, non-child: 906.761ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.59 MB, 116.59 MB, 179.43 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.67 - BytesRead: 179.43 MB (188144203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188144203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188144203) - DecompressionTime: 1s395ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.21 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138782) - RowsReturned: 117.14M (117138782) - RowsReturnedRate: 129.18 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.08K (1080) - ScannerThreadsTotalWallClockTime: 11s240ms - MaterializeTupleTime(*): 2s424ms - ScannerThreadsSysTime: 593.904ms - ScannerThreadsUserTime: 4s765ms - ScannerThreadsVoluntaryContextSwitches: 126.26K (126257) - TotalRawHdfsReadTime(*): 145.144ms - TotalReadThroughput: 119.62 MB/sec Instance 3a46f58658206e67:2d280fcc0000000f (host=vb0218.halxg.cloudera.com:22000):(Total: 1s082ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(500.000ms): 140.91 MB, 53.20 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.377ms - RowsProduced: 1 (1) - TotalCpuTime: 11s267ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 381.370us - TotalStorageWaitTime: 248.902ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.569ms, non-child: 70.569ms, % non-child: 100.00%) - CodegenTime: 792.066us - CompileTime: 8.409ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.155ms - PrepareTime: 44.422ms DataStreamSender (dst_id=2):(Total: 73.634us, non-child: 73.634us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 314.79 KB/sec - OverallThroughput: 212.20 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.738us - TransmitDataRPCTime: 49.636us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s081ms, non-child: 247.271ms, % non-child: 22.86%) ExecOption: Codegen Enabled - BuildTime: 149.956ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 834.361ms, non-child: 834.361ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.61 MB, 116.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.23 MB (188986100) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.23 MB (188986100) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.23 MB (188986100) - DecompressionTime: 1s219ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660055) - RowsReturned: 117.66M (117660055) - RowsReturnedRate: 141.02 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 963 (963) - ScannerThreadsTotalWallClockTime: 10s407ms - MaterializeTupleTime(*): 2s117ms - ScannerThreadsSysTime: 474.923ms - ScannerThreadsUserTime: 4s140ms - ScannerThreadsVoluntaryContextSwitches: 112.12K (112120) - TotalRawHdfsReadTime(*): 142.742ms - TotalReadThroughput: 116.61 MB/sec Instance 3a46f58658206e67:2d280fcc00000003 (host=vb0208.halxg.cloudera.com:22000):(Total: 1s062ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(500.000ms): 136.97 MB, 93.20 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.33 MB (144004896) - PerHostPeakMemUsage: 137.33 MB (144004896) - PrepareTime: 44.720ms - RowsProduced: 1 (1) - TotalCpuTime: 11s172ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 273.412us - TotalStorageWaitTime: 239.166ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.819ms, non-child: 69.819ms, % non-child: 100.00%) - CodegenTime: 750.776us - CompileTime: 8.376ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.124ms - PrepareTime: 43.748ms DataStreamSender (dst_id=2):(Total: 55.876us, non-child: 55.876us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 509.49 KB/sec - OverallThroughput: 279.64 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.764us - TransmitDataRPCTime: 30.668us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s061ms, non-child: 243.280ms, % non-child: 22.92%) ExecOption: Codegen Enabled - BuildTime: 152.710ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 818.346ms, non-child: 818.346ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 113.90 MB, 124.50 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.12 MB (197253024) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.12 MB (197253024) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.12 MB (197253024) - DecompressionTime: 1s386ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.30 MB (143968032) - PerReadThreadRawHdfsThroughput: 1.45 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.77M (122770383) - RowsReturned: 122.77M (122770383) - RowsReturnedRate: 150.02 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.00K (1001) - ScannerThreadsTotalWallClockTime: 10s322ms - MaterializeTupleTime(*): 2s443ms - ScannerThreadsSysTime: 518.914ms - ScannerThreadsUserTime: 4s578ms - ScannerThreadsVoluntaryContextSwitches: 99.89K (99887) - TotalRawHdfsReadTime(*): 126.974ms - TotalReadThroughput: 124.50 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------+--------+----------+---------+----------+-------+-----------+ | 03:AGGREGATE | 1 | 44.07ms | 0ns | 44.07ms | 1 | 1 | | 02:EXCHANGE | 1 | 176.80us | 0ns | 176.80us | 15 | 1 | | 01:AGGREGATE | 15 | 275.71ms | 0ns | 311.25ms | 15 | 1 | | 00:SCAN HDFS | 15 | 936.93ms | 0ns | 1.08s | 1.80B | 180.00M | +--------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=94fdcc290907bd7:a2cbf46c00000000): Summary: Session ID: 4342402377141078:214e361b866c8db8 Session Type: BEESWAX Start Time: 2016-08-24 04:24:53.748986000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.7.0-cdh5-INTERNAL RELEASE (build f25891b0baf667b44941a157e78aaece61a2421c) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:56905 Default Db: tpch_300_parquet Sql Statement: -- Description : Scan fact table while applying non-selective filter on bigint column. -- Target test case : Basic scan and filter. SELECT count(*) FROM lineitem WHERE l_orderkey > 20 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=98.00MB VCores=1 03:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 01:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=1 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_orderkey > 20 table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=179998909 ---------------- Estimated Per-Host Mem: 102760448 Estimated Per-Host VCores: 1 Request Pool: default-pool Planner Timeline: 4.664ms - Analysis finished: 1.468ms (1.468ms) - Equivalence classes computed: 1.579ms (110.934us) - Single node plan created: 2.485ms (905.919us) - Runtime filters computed: 2.533ms (47.971us) - Distributed plan created: 2.988ms (455.338us) - Lineage info computed: 3.561ms (573.313us) - Planning finished: 4.664ms (1.103ms) Query Timeline: 1s520ms - Start execution: 36.820us (36.820us) - Planning finished: 6.671ms (6.634ms) - Ready to start 15 remote fragments: 51.299ms (44.627ms) - All 15 remote fragments started: 53.708ms (2.409ms) - Rows available: 1s469ms (1s416ms) - First row fetched: 1s516ms (46.341ms) - ComputeScanRangeAssignmentTimer: 519.510us ImpalaServer: - ClientFetchWaitTimer: 46.576ms - RowMaterializationTimer: 7.304us Execution Profile 94fdcc290907bd7:a2cbf46c00000000:(Total: 1s464ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 15, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(141.33 MB) vb0222.halxg.cloudera.com:22000(137.83 MB) vb0224.halxg.cloudera.com:22000(139.33 MB) vb0220.halxg.cloudera.com:22000(141.33 MB) vb0206.halxg.cloudera.com:22000(141.33 MB) vb0228.halxg.cloudera.com:22000(137.33 MB) vb0216.halxg.cloudera.com:22000(141.33 MB) vb0232.halxg.cloudera.com:22000(141.40 MB) vb0226.halxg.cloudera.com:22000(141.40 MB) vb0234.halxg.cloudera.com:22000(139.33 MB) vb0230.halxg.cloudera.com:22000(141.33 MB) vb0208.halxg.cloudera.com:22000(141.14 MB) vb0214.halxg.cloudera.com:22000(141.27 MB) vb0212.halxg.cloudera.com:22000(141.33 MB) vb0204.halxg.cloudera.com:22000(141.35 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 1s444ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 0, 12.00 KB, 24.01 KB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 43.598ms - RowsProduced: 0 (0) - TotalCpuTime: 108.563ms - TotalNetworkReceiveTime: 1s400ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 57.833ms, non-child: 57.833ms, % non-child: 100.00%) - CodegenTime: 611.332us - CompileTime: 2.480ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 11.257ms - PrepareTime: 43.397ms AGGREGATION_NODE (id=3):(Total: 1s444ms, non-child: 44.069ms, % non-child: 3.05%) ExecOption: Codegen Enabled - BuildTime: 102.848us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=2):(Total: 1s400ms, non-child: 176.796us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 16.00 B - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 26.944us - DeserializeRowBatchTimer: 71.756us - FirstBatchArrivalWaitTime: 891.751ms - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 10.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1s213ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 140.78 MB completion times: min:909.817ms max:1s417ms mean: 1s241ms stddev:154.922ms execution rates: min:3.04 GB/sec max:4.82 GB/sec mean:3.52 GB/sec stddev:506.89 MB/sec num instances: 15 - AverageThreadTokens: 10.92 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.56 MB (147386279) - PerHostPeakMemUsage: 140.56 MB (147387098) - PrepareTime: 45.571ms - RowsProduced: 1 (1) - TotalCpuTime: 12s803ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 344.849us - TotalStorageWaitTime: 237.629ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.707ms, non-child: 70.707ms, % non-child: 100.00%) - CodegenTime: 776.998us - CompileTime: 8.322ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.146ms - PrepareTime: 44.688ms DataStreamSender (dst_id=2):(Total: 65.887us, non-child: 65.887us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 405.28 KB/sec - OverallThroughput: 247.04 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.037us - TransmitDataRPCTime: 40.727us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s212ms, non-child: 275.705ms, % non-child: 22.74%) - BuildTime: 170.199ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 327.07 KB (334916) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 936.926ms, non-child: 936.926ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.42 - AverageScannerThreadConcurrency: 10.11 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s388ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.52 MB (147345045) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999271) - RowsReturnedRate: 131.24 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1113) - ScannerThreadsTotalWallClockTime: 11s801ms - MaterializeTupleTime(*): 2s414ms - ScannerThreadsSysTime: 536.979ms - ScannerThreadsUserTime: 4s758ms - ScannerThreadsVoluntaryContextSwitches: 114.50K (114501) - TotalRawHdfsReadTime(*): 146.978ms - TotalReadThroughput: 118.54 MB/sec Fragment F00: Instance 94fdcc290907bd7:a2cbf46c0000000e (host=vb0222.halxg.cloudera.com:22000):(Total: 1s389ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB MemoryUsage(500.000ms): 137.47 MB, 137.58 MB, 76.58 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.83 MB (144529184) - PerHostPeakMemUsage: 137.83 MB (144529184) - PrepareTime: 44.202ms - RowsProduced: 1 (1) - TotalCpuTime: 14s884ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 375.080us - TotalStorageWaitTime: 239.594ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.932ms, non-child: 69.932ms, % non-child: 100.00%) - CodegenTime: 694.058us - CompileTime: 8.520ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.511ms - PrepareTime: 43.353ms DataStreamSender (dst_id=2):(Total: 96.650us, non-child: 96.650us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 315.54 KB/sec - OverallThroughput: 161.67 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 34.878us - TransmitDataRPCTime: 49.518us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s388ms, non-child: 304.160ms, % non-child: 21.91%) ExecOption: Codegen Enabled - BuildTime: 189.712ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s084ms, non-child: 1s084ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 114.44 MB, 114.44 MB, 146.33 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.64 MB (197801280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.64 MB (197801280) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.64 MB (197801280) - DecompressionTime: 1s570ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.80 MB (144492320) - PerReadThreadRawHdfsThroughput: 1.29 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112187) - RowsReturned: 123.11M (123112187) - RowsReturnedRate: 113.54 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1324) - ScannerThreadsTotalWallClockTime: 13s707ms - MaterializeTupleTime(*): 2s742ms - ScannerThreadsSysTime: 594.905ms - ScannerThreadsUserTime: 5s467ms - ScannerThreadsVoluntaryContextSwitches: 123.24K (123240) - TotalRawHdfsReadTime(*): 142.579ms - TotalReadThroughput: 97.55 MB/sec Instance 94fdcc290907bd7:a2cbf46c0000000d (host=vb0224.halxg.cloudera.com:22000):(Total: 1s371ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(500.000ms): 139.06 MB, 49.08 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.33 MB (146102048) - PerHostPeakMemUsage: 139.33 MB (146102048) - PrepareTime: 46.687ms - RowsProduced: 1 (1) - TotalCpuTime: 14s353ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 325.584us - TotalStorageWaitTime: 222.589ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.856ms, non-child: 71.856ms, % non-child: 100.00%) - CodegenTime: 767.854us - CompileTime: 8.371ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.186ms - PrepareTime: 45.756ms DataStreamSender (dst_id=2):(Total: 65.886us, non-child: 65.886us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 339.90 KB/sec - OverallThroughput: 237.15 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.682us - TransmitDataRPCTime: 45.970us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s370ms, non-child: 311.246ms, % non-child: 22.72%) ExecOption: Codegen Enabled - BuildTime: 197.879ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s058ms, non-child: 1s058ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 115.58 MB, 115.58 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 189.80 MB (199018915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.80 MB (199018915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.80 MB (199018915) - DecompressionTime: 1s497ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.30 MB (146065184) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 123.88M (123876541) - RowsReturnedRate: 116.99 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1262) - ScannerThreadsTotalWallClockTime: 13s178ms - MaterializeTupleTime(*): 2s602ms - ScannerThreadsSysTime: 577.907ms - ScannerThreadsUserTime: 5s261ms - ScannerThreadsVoluntaryContextSwitches: 135.40K (135396) - TotalRawHdfsReadTime(*): 138.352ms - TotalReadThroughput: 115.58 MB/sec Instance 94fdcc290907bd7:a2cbf46c0000000b (host=vb0206.halxg.cloudera.com:22000):(Total: 1s352ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(500.000ms): 72.38 MB, 140.92 MB, 53.19 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 44.346ms - RowsProduced: 1 (1) - TotalCpuTime: 14s730ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 311.244us - TotalStorageWaitTime: 264.963ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.672ms, non-child: 69.672ms, % non-child: 100.00%) - CodegenTime: 708.881us - CompileTime: 8.453ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.182ms - PrepareTime: 43.474ms DataStreamSender (dst_id=2):(Total: 52.960us, non-child: 52.960us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 505.94 KB/sec - OverallThroughput: 295.03 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.723us - TransmitDataRPCTime: 30.883us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s351ms, non-child: 285.021ms, % non-child: 21.08%) ExecOption: Codegen Enabled - BuildTime: 180.012ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s066ms, non-child: 1s066ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:33.33% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 1.07 MB, 116.61 MB, 116.61 MB - AverageHdfsReadThreadConcurrency: 3.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 190.82 MB (200088922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200088922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200088922) - DecompressionTime: 1s587ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.10 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580633) - RowsReturned: 124.58M (124580633) - RowsReturnedRate: 116.78 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.27K (1267) - ScannerThreadsTotalWallClockTime: 13s616ms - MaterializeTupleTime(*): 2s723ms - ScannerThreadsSysTime: 626.900ms - ScannerThreadsUserTime: 5s448ms - ScannerThreadsVoluntaryContextSwitches: 116.61K (116609) - TotalRawHdfsReadTime(*): 169.562ms - TotalReadThroughput: 77.74 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000009 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s332ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 140.94 MB, 140.91 MB, 22.36 MB ThreadUsage(500.000ms): 12, 12, 6 - AverageThreadTokens: 10.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 43.460ms - RowsProduced: 1 (1) - TotalCpuTime: 14s385ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 364.240us - TotalStorageWaitTime: 244.394ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 68.688ms, non-child: 68.688ms, % non-child: 100.00%) - CodegenTime: 807.310us - CompileTime: 8.394ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.175ms - PrepareTime: 42.567ms DataStreamSender (dst_id=2):(Total: 72.644us, non-child: 72.644us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 329.20 KB/sec - OverallThroughput: 215.09 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.630us - TransmitDataRPCTime: 47.464us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s331ms, non-child: 289.336ms, % non-child: 21.73%) ExecOption: Codegen Enabled - BuildTime: 179.496ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s041ms, non-child: 1s041ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.63 MB, 116.63 MB, 180.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.00 - BytesRead: 180.26 MB (189017820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.26 MB (189017820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.26 MB (189017820) - DecompressionTime: 1s448ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.12 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659823) - RowsReturned: 117.66M (117659823) - RowsReturnedRate: 112.92 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.25K (1254) - ScannerThreadsTotalWallClockTime: 13s271ms - MaterializeTupleTime(*): 2s470ms - ScannerThreadsSysTime: 625.898ms - ScannerThreadsUserTime: 4s951ms - ScannerThreadsVoluntaryContextSwitches: 110.92K (110917) - TotalRawHdfsReadTime(*): 156.527ms - TotalReadThroughput: 120.17 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000005 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s315ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB MemoryUsage(500.000ms): 139.12 MB, 74.95 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.33 MB (146102048) - PerHostPeakMemUsage: 139.33 MB (146102048) - PrepareTime: 44.248ms - RowsProduced: 1 (1) - TotalCpuTime: 14s283ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 284.386us - TotalStorageWaitTime: 280.673ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.524ms, non-child: 69.524ms, % non-child: 100.00%) - CodegenTime: 790.896us - CompileTime: 8.451ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.147ms - PrepareTime: 43.369ms DataStreamSender (dst_id=2):(Total: 67.416us, non-child: 67.416us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 327.72 KB/sec - OverallThroughput: 231.77 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.132us - TransmitDataRPCTime: 47.678us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s314ms, non-child: 275.754ms, % non-child: 20.97%) ExecOption: Codegen Enabled - BuildTime: 171.517ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s039ms, non-child: 1s039ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 115.48 MB, 115.48 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 189.70 MB (198913222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.70 MB (198913222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.70 MB (198913222) - DecompressionTime: 1s500ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.30 MB (146065184) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123827522) - RowsReturned: 123.83M (123827522) - RowsReturnedRate: 119.17 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.26K (1256) - ScannerThreadsTotalWallClockTime: 13s221ms - MaterializeTupleTime(*): 2s551ms - ScannerThreadsSysTime: 603.904ms - ScannerThreadsUserTime: 5s141ms - ScannerThreadsVoluntaryContextSwitches: 116.54K (116540) - TotalRawHdfsReadTime(*): 156.324ms - TotalReadThroughput: 115.48 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000002 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s301ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(500.000ms): 140.89 MB, 53.20 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.27 MB (148133656) - PerHostPeakMemUsage: 141.27 MB (148133656) - PrepareTime: 47.174ms - RowsProduced: 1 (1) - TotalCpuTime: 13s892ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 306.130us - TotalStorageWaitTime: 206.031ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.319ms, non-child: 72.319ms, % non-child: 100.00%) - CodegenTime: 824.168us - CompileTime: 8.317ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.159ms - PrepareTime: 46.281ms DataStreamSender (dst_id=2):(Total: 45.674us, non-child: 45.674us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 652.46 KB/sec - OverallThroughput: 342.10 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.712us - TransmitDataRPCTime: 23.948us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s300ms, non-child: 279.670ms, % non-child: 21.50%) ExecOption: Codegen Enabled - BuildTime: 172.692ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s020ms, non-child: 1s020ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.62 MB, 116.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 179.43 MB (188144203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188144203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188144203) - DecompressionTime: 1s475ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.24 MB (148096792) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138782) - RowsReturned: 117.14M (117138782) - RowsReturnedRate: 114.74 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.24K (1240) - ScannerThreadsTotalWallClockTime: 12s770ms - MaterializeTupleTime(*): 2s563ms - ScannerThreadsSysTime: 584.908ms - ScannerThreadsUserTime: 5s067ms - ScannerThreadsVoluntaryContextSwitches: 109.49K (109490) - TotalRawHdfsReadTime(*): 142.104ms - TotalReadThroughput: 116.62 MB/sec Instance 94fdcc290907bd7:a2cbf46c0000000f (host=vb0218.halxg.cloudera.com:22000):(Total: 1s296ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(500.000ms): 80.38 MB, 140.81 MB, 53.12 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 46.837ms - RowsProduced: 1 (1) - TotalCpuTime: 13s814ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 257.728us - TotalStorageWaitTime: 205.206ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.668ms, non-child: 72.668ms, % non-child: 100.00%) - CodegenTime: 704.010us - CompileTime: 8.500ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.612ms - PrepareTime: 45.988ms DataStreamSender (dst_id=2):(Total: 55.236us, non-child: 55.236us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 456.76 KB/sec - OverallThroughput: 282.88 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.102us - TransmitDataRPCTime: 34.208us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s295ms, non-child: 309.199ms, % non-child: 23.87%) ExecOption: Codegen Enabled - BuildTime: 191.355ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 985.890ms, non-child: 985.890ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:33.33% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 1.07 MB, 116.62 MB, 116.62 MB - AverageHdfsReadThreadConcurrency: 3.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.23 MB (188986100) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.23 MB (188986100) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.23 MB (188986100) - DecompressionTime: 1s436ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.36 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660055) - RowsReturned: 117.66M (117660055) - RowsReturnedRate: 119.34 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.18K (1181) - ScannerThreadsTotalWallClockTime: 12s696ms - MaterializeTupleTime(*): 2s501ms - ScannerThreadsSysTime: 582.907ms - ScannerThreadsUserTime: 4s944ms - ScannerThreadsVoluntaryContextSwitches: 115.15K (115148) - TotalRawHdfsReadTime(*): 129.605ms - TotalReadThroughput: 77.75 MB/sec Instance 94fdcc290907bd7:a2cbf46c0000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 1s285ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB MemoryUsage(500.000ms): 136.92 MB, 137.06 MB, 68.33 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.33 MB (144004896) - PerHostPeakMemUsage: 137.33 MB (144004896) - PrepareTime: 43.905ms - RowsProduced: 1 (1) - TotalCpuTime: 13s915ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 256.459us - TotalStorageWaitTime: 229.794ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 68.308ms, non-child: 68.308ms, % non-child: 100.00%) - CodegenTime: 695.216us - CompileTime: 7.958ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.682ms - PrepareTime: 43.139ms DataStreamSender (dst_id=2):(Total: 63.026us, non-child: 63.026us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 345.12 KB/sec - OverallThroughput: 247.91 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 6.930us - TransmitDataRPCTime: 45.274us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s284ms, non-child: 278.098ms, % non-child: 21.65%) ExecOption: Codegen Enabled - BuildTime: 174.333ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s006ms, non-child: 1s006ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:33.33% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 114.10 MB, 114.10 MB, 135.41 MB - AverageHdfsReadThreadConcurrency: 0.33 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.32 MB (197467446) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.32 MB (197467446) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.32 MB (197467446) - DecompressionTime: 1s520ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.30 MB (143968032) - PerReadThreadRawHdfsThroughput: 1.19 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.89M (122890709) - RowsReturned: 122.89M (122890709) - RowsReturnedRate: 122.09 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.19K (1190) - ScannerThreadsTotalWallClockTime: 12s834ms - MaterializeTupleTime(*): 2s648ms - ScannerThreadsSysTime: 640.896ms - ScannerThreadsUserTime: 5s227ms - ScannerThreadsVoluntaryContextSwitches: 116.50K (116498) - TotalRawHdfsReadTime(*): 154.595ms - TotalReadThroughput: 90.27 MB/sec Instance 94fdcc290907bd7:a2cbf46c0000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 1s273ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB MemoryUsage(500.000ms): 140.87 MB, 53.05 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 44.683ms - RowsProduced: 1 (1) - TotalCpuTime: 13s392ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 370.726us - TotalStorageWaitTime: 279.228ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 69.591ms, non-child: 69.591ms, % non-child: 100.00%) - CodegenTime: 1.317ms - CompileTime: 8.440ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.081ms - PrepareTime: 43.521ms DataStreamSender (dst_id=2):(Total: 64.364us, non-child: 64.364us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 358.60 KB/sec - OverallThroughput: 242.76 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.940us - TransmitDataRPCTime: 43.572us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s272ms, non-child: 254.717ms, % non-child: 20.02%) ExecOption: Codegen Enabled - BuildTime: 157.902ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 363.01 KB (371720) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s017ms, non-child: 1s017ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 116.63 MB, 116.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 169.66 MB (177904158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177904158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177904158) - DecompressionTime: 1s444ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.24 MB (148096792) - PerReadThreadRawHdfsThroughput: 1.09 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738860) - RowsReturned: 110.74M (110738835) - RowsReturnedRate: 108.79 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 1.17K (1165) - ScannerThreadsTotalWallClockTime: 12s371ms - MaterializeTupleTime(*): 2s487ms - ScannerThreadsSysTime: 621.900ms - ScannerThreadsUserTime: 4s943ms - ScannerThreadsVoluntaryContextSwitches: 115.54K (115537) - TotalRawHdfsReadTime(*): 152.373ms - TotalReadThroughput: 116.63 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000007 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s233ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB MemoryUsage(500.000ms): 141.12 MB, 132.97 MB, 31.23 MB ThreadUsage(500.000ms): 12, 12, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.40 MB (148264744) - PerHostPeakMemUsage: 141.40 MB (148264744) - PrepareTime: 43.557ms - RowsProduced: 1 (1) - TotalCpuTime: 13s211ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 330.252us - TotalStorageWaitTime: 223.335ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 67.847ms, non-child: 67.847ms, % non-child: 100.00%) - CodegenTime: 667.558us - CompileTime: 7.846ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.696ms - PrepareTime: 42.794ms DataStreamSender (dst_id=2):(Total: 45.530us, non-child: 45.530us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 613.47 KB/sec - OverallThroughput: 343.18 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.742us - TransmitDataRPCTime: 25.470us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s232ms, non-child: 301.942ms, % non-child: 24.49%) ExecOption: Codegen Enabled - BuildTime: 187.766ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 930.888ms, non-child: 930.888ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.62 MB, 116.62 MB, 190.83 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 190.83 MB (200101412) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101412) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101412) - DecompressionTime: 1s323ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.36 MB (148227880) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581309) - RowsReturned: 124.58M (124581309) - RowsReturnedRate: 133.83 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.12K (1118) - ScannerThreadsTotalWallClockTime: 12s175ms - MaterializeTupleTime(*): 2s300ms - ScannerThreadsSysTime: 512.914ms - ScannerThreadsUserTime: 4s552ms - ScannerThreadsVoluntaryContextSwitches: 117.95K (117947) - TotalRawHdfsReadTime(*): 154.694ms - TotalReadThroughput: 127.22 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000004 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s117ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB MemoryUsage(500.000ms): 28.00 KB, 140.95 MB, 75.04 MB ThreadUsage(500.000ms): 1, 12, 7 - AverageThreadTokens: 6.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 47.433ms - RowsProduced: 1 (1) - TotalCpuTime: 11s682ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 322.124us - TotalStorageWaitTime: 238.493ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.872ms, non-child: 71.872ms, % non-child: 100.00%) - CodegenTime: 677.348us - CompileTime: 7.854ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.782ms - PrepareTime: 46.723ms DataStreamSender (dst_id=2):(Total: 89.746us, non-child: 89.746us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 336.12 KB/sec - OverallThroughput: 174.10 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 29.964us - TransmitDataRPCTime: 46.486us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s116ms, non-child: 280.787ms, % non-child: 25.15%) ExecOption: Codegen Enabled - BuildTime: 169.537ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 835.790ms, non-child: 835.790ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 117.14 MB, 180.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.50 - BytesRead: 180.75 MB (189534707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189534707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189534707) - DecompressionTime: 1s168ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117849031) - RowsReturned: 117.85M (117849031) - RowsReturnedRate: 141.00 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.00K (1002) - ScannerThreadsTotalWallClockTime: 10s778ms - MaterializeTupleTime(*): 2s041ms - ScannerThreadsSysTime: 443.926ms - ScannerThreadsUserTime: 4s058ms - ScannerThreadsVoluntaryContextSwitches: 111.91K (111906) - TotalRawHdfsReadTime(*): 150.141ms - TotalReadThroughput: 120.50 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s047ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(500.000ms): 141.06 MB, 78.86 MB ThreadUsage(500.000ms): 12, 7 - AverageThreadTokens: 9.50 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.40 MB (148264744) - PerHostPeakMemUsage: 141.40 MB (148264744) - PrepareTime: 47.745ms - RowsProduced: 1 (1) - TotalCpuTime: 10s413ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 409.406us - TotalStorageWaitTime: 179.386ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 73.027ms, non-child: 73.027ms, % non-child: 100.00%) - CodegenTime: 699.704us - CompileTime: 8.439ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.152ms - PrepareTime: 46.888ms DataStreamSender (dst_id=2):(Total: 62.834us, non-child: 62.834us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 421.39 KB/sec - OverallThroughput: 248.67 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 14.648us - TransmitDataRPCTime: 37.080us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s046ms, non-child: 249.960ms, % non-child: 23.89%) ExecOption: Codegen Enabled - BuildTime: 156.898ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 796.266ms, non-child: 796.266ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.62 MB, 180.75 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.50 - BytesRead: 180.75 MB (189526837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189526837) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189526837) - DecompressionTime: 1s290ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.36 MB (148227880) - PerReadThreadRawHdfsThroughput: 1.58 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852239) - RowsReturned: 117.85M (117852239) - RowsReturnedRate: 148.01 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 884 (884) - ScannerThreadsTotalWallClockTime: 9s518ms - MaterializeTupleTime(*): 2s285ms - ScannerThreadsSysTime: 441.927ms - ScannerThreadsUserTime: 4s349ms - ScannerThreadsVoluntaryContextSwitches: 114.78K (114781) - TotalRawHdfsReadTime(*): 111.857ms - TotalReadThroughput: 180.75 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000001 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s026ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB MemoryUsage(500.000ms): 140.96 MB, 69.11 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 44.748ms - RowsProduced: 1 (1) - TotalCpuTime: 10s698ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 406.976us - TotalStorageWaitTime: 236.391ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.406ms, non-child: 70.406ms, % non-child: 100.00%) - CodegenTime: 882.288us - CompileTime: 8.712ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.427ms - PrepareTime: 43.703ms DataStreamSender (dst_id=2):(Total: 72.780us, non-child: 72.780us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 290.49 KB/sec - OverallThroughput: 214.69 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.126us - TransmitDataRPCTime: 53.788us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s024ms, non-child: 248.453ms, % non-child: 24.24%) ExecOption: Codegen Enabled - BuildTime: 150.681ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 776.524ms, non-child: 776.524ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.63 MB, 116.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.24 MB (188991096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188991096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188991096) - DecompressionTime: 1s016ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659771) - RowsReturned: 117.66M (117659771) - RowsReturnedRate: 151.52 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 904 (904) - ScannerThreadsTotalWallClockTime: 9s881ms - MaterializeTupleTime(*): 1s749ms - ScannerThreadsSysTime: 364.940ms - ScannerThreadsUserTime: 3s505ms - ScannerThreadsVoluntaryContextSwitches: 107.28K (107282) - TotalRawHdfsReadTime(*): 148.861ms - TotalReadThroughput: 116.63 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000006 (host=vb0204.halxg.cloudera.com:22000):(Total: 979.651ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB MemoryUsage(500.000ms): 133.07 MB, 4.45 MB ThreadUsage(500.000ms): 12, 2 - AverageThreadTokens: 7.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.35 MB (148211488) - PrepareTime: 48.658ms - RowsProduced: 1 (1) - TotalCpuTime: 9s738ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 520.280us - TotalStorageWaitTime: 246.547ms CodeGen:(Total: 73.575ms, non-child: 73.575ms, % non-child: 100.00%) - CodegenTime: 725.076us - CompileTime: 8.096ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.089ms - PrepareTime: 47.813ms DataStreamSender (dst_id=2):(Total: 69.452us, non-child: 69.452us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 378.73 KB/sec - OverallThroughput: 224.97 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.476us - TransmitDataRPCTime: 41.256us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 978.566ms, non-child: 211.930ms, % non-child: 21.66%) ExecOption: Codegen Enabled - BuildTime: 123.794ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 766.635ms, non-child: 766.635ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.62 MB, 180.67 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 6.00 - BytesRead: 180.67 MB (189441106) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.67 MB (189441106) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.67 MB (189441106) - DecompressionTime: 1s403ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.79M (117791246) - RowsReturned: 117.79M (117791246) - RowsReturnedRate: 153.65 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 875 (875) - ScannerThreadsTotalWallClockTime: 8s979ms - MaterializeTupleTime(*): 2s510ms - ScannerThreadsSysTime: 525.915ms - ScannerThreadsUserTime: 4s581ms - ScannerThreadsVoluntaryContextSwitches: 92.73K (92727) - TotalRawHdfsReadTime(*): 147.211ms - TotalReadThroughput: 180.67 MB/sec Instance 94fdcc290907bd7:a2cbf46c00000003 (host=vb0208.halxg.cloudera.com:22000):(Total: 882.011ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(500.000ms): 136.95 MB, 61.27 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.14 MB (147998472) - PerHostPeakMemUsage: 141.14 MB (147998472) - PrepareTime: 45.883ms - RowsProduced: 1 (1) - TotalCpuTime: 8s657ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 332.132us - TotalStorageWaitTime: 267.809ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.315ms, non-child: 71.315ms, % non-child: 100.00%) - CodegenTime: 693.458us - CompileTime: 8.478ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.305ms - PrepareTime: 44.955ms DataStreamSender (dst_id=2):(Total: 64.120us, non-child: 64.120us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 407.79 KB/sec - OverallThroughput: 243.68 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.874us - TransmitDataRPCTime: 38.316us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 880.791ms, non-child: 255.304ms, % non-child: 28.99%) ExecOption: Codegen Enabled - BuildTime: 149.418ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 1.00 /sec - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 625.486ms, non-child: 625.486ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 113.91 MB, 124.52 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.12 MB (197253024) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.12 MB (197253024) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.12 MB (197253024) - DecompressionTime: 1s148ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.11 MB (147961608) - PerReadThreadRawHdfsThroughput: 1.23 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.77M (122770383) - RowsReturned: 122.77M (122770383) - RowsReturnedRate: 196.28 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 773 (773) - ScannerThreadsTotalWallClockTime: 8s016ms - MaterializeTupleTime(*): 2s035ms - ScannerThreadsSysTime: 304.948ms - ScannerThreadsUserTime: 3s873ms - ScannerThreadsVoluntaryContextSwitches: 113.50K (113505) - TotalRawHdfsReadTime(*): 149.893ms - TotalReadThroughput: 124.52 MB/sec ================================================================================ ================================================================================ SUMMARY: +--------------+--------+----------+---------+----------+-------+-----------+ | Operator | #Hosts | Avg Time | Std Dev | Max Time | #Rows | Est #Rows | +--------------+--------+----------+---------+----------+-------+-----------+ | 03:AGGREGATE | 1 | 43.57ms | 0ns | 43.57ms | 1 | 1 | | 02:EXCHANGE | 1 | 177.84us | 0ns | 177.84us | 15 | 1 | | 01:AGGREGATE | 15 | 287.88ms | 0ns | 339.20ms | 15 | 1 | | 00:SCAN HDFS | 15 | 1.01s | 0ns | 1.21s | 1.80B | 180.00M | +--------------+--------+----------+---------+----------+-------+-----------+ PROFILE: Query (id=a445907a420a80b6:e1f70fb800000000): Summary: Session ID: ad4204a6d437596b:2a463f01e2965f96 Session Type: BEESWAX Start Time: 2016-08-24 04:24:55.332792000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.7.0-cdh5-INTERNAL RELEASE (build f25891b0baf667b44941a157e78aaece61a2421c) User: jenkins Connected User: jenkins Delegated User: Network Address: 10.17.193.6:56908 Default Db: tpch_300_parquet Sql Statement: -- Description : Scan fact table while applying non-selective filter on bigint column. -- Target test case : Basic scan and filter. SELECT count(*) FROM lineitem WHERE l_orderkey > 20 Coordinator: vb0204.halxg.cloudera.com:22000 Query Options (non default): NUM_SCANNER_THREADS=12,SYNC_DDL=1,MAX_NUM_RUNTIME_FILTERS=50 Plan: ---------------- Estimated Per-Host Requirements: Memory=98.00MB VCores=1 03:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 02:EXCHANGE [UNPARTITIONED] | hosts=15 per-host-mem=unavailable | tuple-ids=1 row-size=8B cardinality=1 | 01:AGGREGATE | output: count(*) | hosts=15 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=1 | 00:SCAN HDFS [tpch_300_parquet.lineitem, RANDOM] partitions=1/1 files=264 size=64.36GB predicates: l_orderkey > 20 table stats: 1799989091 rows total column stats: all hosts=15 per-host-mem=88.00MB tuple-ids=0 row-size=8B cardinality=179998909 ---------------- Estimated Per-Host Mem: 102760448 Estimated Per-Host VCores: 1 Request Pool: default-pool Planner Timeline: 4.599ms - Analysis finished: 1.457ms (1.457ms) - Equivalence classes computed: 1.565ms (108.762us) - Single node plan created: 2.468ms (903.012us) - Runtime filters computed: 2.503ms (34.286us) - Distributed plan created: 2.940ms (437.821us) - Lineage info computed: 3.505ms (565.063us) - Planning finished: 4.599ms (1.093ms) Query Timeline: 1s620ms - Start execution: 39.264us (39.264us) - Planning finished: 6.622ms (6.583ms) - Ready to start 15 remote fragments: 51.048ms (44.425ms) - All 15 remote fragments started: 53.809ms (2.760ms) - Rows available: 1s574ms (1s520ms) - First row fetched: 1s615ms (40.957ms) - ComputeScanRangeAssignmentTimer: 530.572us ImpalaServer: - ClientFetchWaitTimer: 41.206ms - RowMaterializationTimer: 8.214us Execution Profile a445907a420a80b6:e1f70fb800000000:(Total: 1s569ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 15, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 2ms Per Node Peak Memory Usage: vb0218.halxg.cloudera.com:22000(141.33 MB) vb0222.halxg.cloudera.com:22000(137.83 MB) vb0224.halxg.cloudera.com:22000(141.33 MB) vb0220.halxg.cloudera.com:22000(141.35 MB) vb0206.halxg.cloudera.com:22000(141.33 MB) vb0228.halxg.cloudera.com:22000(137.33 MB) vb0216.halxg.cloudera.com:22000(141.33 MB) vb0232.halxg.cloudera.com:22000(141.33 MB) vb0226.halxg.cloudera.com:22000(141.33 MB) vb0234.halxg.cloudera.com:22000(139.37 MB) vb0230.halxg.cloudera.com:22000(141.33 MB) vb0208.halxg.cloudera.com:22000(137.33 MB) vb0214.halxg.cloudera.com:22000(139.33 MB) vb0212.halxg.cloudera.com:22000(141.37 MB) vb0204.halxg.cloudera.com:22000(141.34 MB) - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F01:(Total: 1s549ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(500.000ms): 12.00 KB, 12.00 KB, 60.01 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 80.02 KB (81936) - PerHostPeakMemUsage: 0 - PrepareTime: 43.383ms - RowsProduced: 0 (0) - TotalCpuTime: 102.375ms - TotalNetworkReceiveTime: 1s506ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 57.147ms, non-child: 57.147ms, % non-child: 100.00%) - CodegenTime: 635.884us - CompileTime: 2.956ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 7 (7) - NumInstructions: 96 (96) - OptimizationTime: 9.348ms - PrepareTime: 44.146ms AGGREGATION_NODE (id=3):(Total: 1s549ms, non-child: 43.567ms, % non-child: 2.81%) ExecOption: Codegen Enabled - BuildTime: 58.098us - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 72.00 KB (73728) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=2):(Total: 1s506ms, non-child: 177.838us, % non-child: 0.01%) BytesReceived(500.000ms): 0, 0, 160.00 B - BytesReceived: 240.00 B (240) - ConvertRowBatchTime: 24.344us - DeserializeRowBatchTimer: 71.040us - FirstBatchArrivalWaitTime: 1s031ms - PeakMemoryUsage: 0 - RowsReturned: 15 (15) - RowsReturnedRate: 9.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F00:(Total: 1s297ms, non-child: 0.000ns, % non-child: 0.00%) split sizes: min: 3.96 GB, max: 4.45 GB, avg: 4.29 GB, stddev: 140.78 MB completion times: min:1s048ms max:1s521ms mean: 1s325ms stddev:124.479ms execution rates: min:2.76 GB/sec max:4.02 GB/sec mean:3.27 GB/sec stddev:322.32 MB/sec num instances: 15 - AverageThreadTokens: 10.87 - BloomFilterBytes: 0 - PeakMemoryUsage: 140.31 MB (147120587) - PerHostPeakMemUsage: 140.31 MB (147121406) - PrepareTime: 46.735ms - RowsProduced: 1 (1) - TotalCpuTime: 13s769ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 317.439us - TotalStorageWaitTime: 223.119ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.135ms, non-child: 72.135ms, % non-child: 100.00%) - CodegenTime: 766.321us - CompileTime: 8.428ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.288ms - PrepareTime: 45.857ms DataStreamSender (dst_id=2):(Total: 59.735us, non-child: 59.735us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 502.64 KB/sec - OverallThroughput: 282.50 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 11.875us - TransmitDataRPCTime: 36.417us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s296ms, non-child: 287.875ms, % non-child: 22.20%) - BuildTime: 178.185ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 327.07 KB (334916) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s008ms, non-child: 1s008ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.22 - AverageScannerThreadConcurrency: 10.49 - BytesRead: 183.88 MB (192812683) - BytesReadDataNodeCache: 0 - BytesReadLocal: 183.88 MB (192812683) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 183.88 MB (192812683) - DecompressionTime: 1s499ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 140.26 MB (147077169) - PerReadThreadRawHdfsThroughput: 1.31 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 120.00M (119999272) - RowsReturned: 120.00M (119999271) - RowsReturnedRate: 120.39 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.20K (1203) - ScannerThreadsTotalWallClockTime: 12s668ms - MaterializeTupleTime(*): 2s585ms - ScannerThreadsSysTime: 576.773ms - ScannerThreadsUserTime: 5s123ms - ScannerThreadsVoluntaryContextSwitches: 113.93K (113927) - TotalRawHdfsReadTime(*): 138.157ms - TotalReadThroughput: 112.90 MB/sec Fragment F00: Instance a445907a420a80b6:e1f70fb80000000f (host=vb0218.halxg.cloudera.com:22000):(Total: 1s494ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB MemoryUsage(500.000ms): 0, 141.12 MB, 76.96 MB, 8.89 MB ThreadUsage(500.000ms): 1, 12, 12, 3 - AverageThreadTokens: 7.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.182ms - RowsProduced: 1 (1) - TotalCpuTime: 15s710ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 343.524us - TotalStorageWaitTime: 222.519ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.882ms, non-child: 70.882ms, % non-child: 100.00%) - CodegenTime: 686.162us - CompileTime: 8.549ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.461ms - PrepareTime: 44.294ms DataStreamSender (dst_id=2):(Total: 39.054us, non-child: 39.054us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 768.04 KB/sec - OverallThroughput: 400.09 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.020us - TransmitDataRPCTime: 20.344us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s493ms, non-child: 286.259ms, % non-child: 19.17%) ExecOption: Codegen Enabled - BuildTime: 176.881ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s206ms, non-child: 1s206ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:1/253.39 MB 5:1/253.41 MB 8:1/253.40 MB 1:1/253.38 MB 7:2/506.78 MB 4:1/253.40 MB 9:2/506.80 MB 6:2/506.79 MB 0:3/760.16 MB 2:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.62 MB, 116.62 MB, 180.23 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 8.00 - BytesRead: 180.23 MB (188986100) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.23 MB (188986100) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.23 MB (188986100) - DecompressionTime: 1s609ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.30 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117660055) - RowsReturned: 117.66M (117660055) - RowsReturnedRate: 97.50 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.38K (1383) - ScannerThreadsTotalWallClockTime: 14s412ms - MaterializeTupleTime(*): 2s749ms - ScannerThreadsSysTime: 719.885ms - ScannerThreadsUserTime: 5s524ms - ScannerThreadsVoluntaryContextSwitches: 122.65K (122652) - TotalRawHdfsReadTime(*): 135.484ms - TotalReadThroughput: 120.15 MB/sec Instance a445907a420a80b6:e1f70fb800000007 (host=vb0226.halxg.cloudera.com:22000):(Total: 1s437ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB MemoryUsage(500.000ms): 141.00 MB, 141.04 MB, 53.30 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 45.846ms - RowsProduced: 1 (1) - TotalCpuTime: 15s183ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 283.802us - TotalStorageWaitTime: 210.400ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.046ms, non-child: 70.046ms, % non-child: 100.00%) - CodegenTime: 803.876us - CompileTime: 7.863ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.627ms - PrepareTime: 45.027ms DataStreamSender (dst_id=2):(Total: 47.264us, non-child: 47.264us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 631.26 KB/sec - OverallThroughput: 330.59 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 12.032us - TransmitDataRPCTime: 24.752us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s436ms, non-child: 298.413ms, % non-child: 20.78%) ExecOption: Codegen Enabled - BuildTime: 187.954ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s137ms, non-child: 1s137ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.41 MB 4:2/506.80 MB 5:2/506.78 MB 7:1/253.41 MB 3:2/506.77 MB 0:2/506.77 MB 2:2/506.79 MB 1:2/506.82 MB 10:1/253.40 MB 9:2/506.79 MB 6:1/253.39 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.62 MB, 116.62 MB, 116.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 190.83 MB (200101412) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.83 MB (200101412) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.83 MB (200101412) - DecompressionTime: 1s626ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124581309) - RowsReturned: 124.58M (124581309) - RowsReturnedRate: 109.49 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.31K (1308) - ScannerThreadsTotalWallClockTime: 13s931ms - MaterializeTupleTime(*): 2s797ms - ScannerThreadsSysTime: 634.897ms - ScannerThreadsUserTime: 5s629ms - ScannerThreadsVoluntaryContextSwitches: 121.16K (121158) - TotalRawHdfsReadTime(*): 134.874ms - TotalReadThroughput: 77.75 MB/sec Instance a445907a420a80b6:e1f70fb800000003 (host=vb0208.halxg.cloudera.com:22000):(Total: 1s427ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB MemoryUsage(500.000ms): 28.00 KB, 137.02 MB, 61.07 MB ThreadUsage(500.000ms): 1, 12, 12 - AverageThreadTokens: 8.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.33 MB (144004896) - PerHostPeakMemUsage: 137.33 MB (144004896) - PrepareTime: 43.320ms - RowsProduced: 1 (1) - TotalCpuTime: 15s135ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 309.558us - TotalStorageWaitTime: 252.336ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 68.708ms, non-child: 68.708ms, % non-child: 100.00%) - CodegenTime: 783.908us - CompileTime: 8.594ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.163ms - PrepareTime: 42.362ms DataStreamSender (dst_id=2):(Total: 60.196us, non-child: 60.196us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 381.39 KB/sec - OverallThroughput: 259.57 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.056us - TransmitDataRPCTime: 40.968us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s426ms, non-child: 315.010ms, % non-child: 22.08%) ExecOption: Codegen Enabled - BuildTime: 199.320ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s111ms, non-child: 1s111ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 5:2/506.80 MB 2:1/253.39 MB 1:1/253.39 MB 3:2/506.78 MB 6:3/760.18 MB 7:2/506.79 MB 4:2/506.78 MB 10:1/187.22 MB 0:4/1013.56 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 0, 113.91 MB, 124.51 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.12 MB (197253024) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.12 MB (197253024) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.12 MB (197253024) - DecompressionTime: 1s527ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.30 MB (143968032) - PerReadThreadRawHdfsThroughput: 1.20 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.77M (122770383) - RowsReturned: 122.77M (122770383) - RowsReturnedRate: 110.46 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.29K (1293) - ScannerThreadsTotalWallClockTime: 13s934ms - MaterializeTupleTime(*): 2s637ms - ScannerThreadsSysTime: 523.914ms - ScannerThreadsUserTime: 5s319ms - ScannerThreadsVoluntaryContextSwitches: 120.92K (120923) - TotalRawHdfsReadTime(*): 153.726ms - TotalReadThroughput: 83.01 MB/sec Instance a445907a420a80b6:e1f70fb80000000e (host=vb0222.halxg.cloudera.com:22000):(Total: 1s410ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB MemoryUsage(500.000ms): 80.38 MB, 137.48 MB, 61.18 MB ThreadUsage(500.000ms): 12, 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.83 MB (144529184) - PerHostPeakMemUsage: 137.83 MB (144529184) - PrepareTime: 47.098ms - RowsProduced: 1 (1) - TotalCpuTime: 15s335ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 397.818us - TotalStorageWaitTime: 216.535ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.579ms, non-child: 72.579ms, % non-child: 100.00%) - CodegenTime: 659.990us - CompileTime: 8.649ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.141ms - PrepareTime: 46.210ms DataStreamSender (dst_id=2):(Total: 47.496us, non-child: 47.496us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 692.60 KB/sec - OverallThroughput: 328.97 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.450us - TransmitDataRPCTime: 22.560us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s409ms, non-child: 284.410ms, % non-child: 20.18%) ExecOption: Codegen Enabled - BuildTime: 177.109ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s124ms, non-child: 1s124ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 2:2/506.77 MB 4:1/253.39 MB 0:1/253.40 MB 9:2/506.79 MB 8:1/253.41 MB 7:2/506.82 MB 6:2/506.78 MB 5:1/199.72 MB 3:4/1013.56 MB 1:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:66.67% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:33.33% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 1.07 MB, 114.42 MB, 125.02 MB - AverageHdfsReadThreadConcurrency: 3.33 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.64 MB (197801280) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.64 MB (197801280) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.64 MB (197801280) - DecompressionTime: 1s588ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.80 MB (144492320) - PerReadThreadRawHdfsThroughput: 1.34 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.11M (123112187) - RowsReturned: 123.11M (123112187) - RowsReturnedRate: 109.46 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.33K (1334) - ScannerThreadsTotalWallClockTime: 14s115ms - MaterializeTupleTime(*): 2s695ms - ScannerThreadsSysTime: 631.898ms - ScannerThreadsUserTime: 5s477ms - ScannerThreadsVoluntaryContextSwitches: 120.27K (120265) - TotalRawHdfsReadTime(*): 137.552ms - TotalReadThroughput: 83.35 MB/sec Instance a445907a420a80b6:e1f70fb800000009 (host=vb0216.halxg.cloudera.com:22000):(Total: 1s390ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB MemoryUsage(500.000ms): 140.85 MB, 141.00 MB, 74.88 MB ThreadUsage(500.000ms): 12, 12, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 47.163ms - RowsProduced: 1 (1) - TotalCpuTime: 14s919ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 243.906us - TotalStorageWaitTime: 191.499ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 73.570ms, non-child: 73.570ms, % non-child: 100.00%) - CodegenTime: 685.962us - CompileTime: 8.878ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.815ms - PrepareTime: 46.297ms DataStreamSender (dst_id=2):(Total: 47.502us, non-child: 47.502us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 567.81 KB/sec - OverallThroughput: 328.93 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 9.320us - TransmitDataRPCTime: 27.518us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s389ms, non-child: 300.018ms, % non-child: 21.60%) ExecOption: Codegen Enabled - BuildTime: 183.297ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s089ms, non-child: 1s089ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 5:1/253.40 MB 2:1/253.40 MB 3:2/506.80 MB 4:3/760.21 MB 9:1/253.41 MB 7:1/253.39 MB 6:3/760.20 MB 0:2/506.79 MB 10:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.63 MB, 116.63 MB, 180.26 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 180.26 MB (189017820) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.26 MB (189017820) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.26 MB (189017820) - DecompressionTime: 1s532ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.43 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659823) - RowsReturned: 117.66M (117659823) - RowsReturnedRate: 108.02 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.32K (1316) - ScannerThreadsTotalWallClockTime: 13s693ms - MaterializeTupleTime(*): 2s640ms - ScannerThreadsSysTime: 616.900ms - ScannerThreadsUserTime: 5s309ms - ScannerThreadsVoluntaryContextSwitches: 114.80K (114797) - TotalRawHdfsReadTime(*): 122.974ms - TotalReadThroughput: 120.17 MB/sec Instance a445907a420a80b6:e1f70fb800000006 (host=vb0204.halxg.cloudera.com:22000):(Total: 1s354ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB MemoryUsage(500.000ms): 141.04 MB, 61.17 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148191008) - PerHostPeakMemUsage: 141.34 MB (148203296) - PrepareTime: 49.979ms - RowsProduced: 1 (1) - TotalCpuTime: 14s130ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 262.984us - TotalStorageWaitTime: 238.528ms CodeGen:(Total: 74.498ms, non-child: 74.498ms, % non-child: 100.00%) - CodegenTime: 645.550us - CompileTime: 7.826ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 16.825ms - PrepareTime: 49.331ms DataStreamSender (dst_id=2):(Total: 80.838us, non-child: 80.838us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 259.33 KB/sec - OverallThroughput: 193.29 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.568us - TransmitDataRPCTime: 60.252us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s353ms, non-child: 339.197ms, % non-child: 25.06%) ExecOption: Codegen Enabled - BuildTime: 205.419ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s014ms, non-child: 1s014ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 8:1/253.39 MB 10:1/253.39 MB 5:1/253.42 MB 9:1/253.41 MB 4:2/506.79 MB 1:2/506.76 MB 2:2/506.78 MB 7:2/258.66 MB 6:4/1013.62 MB 0:2/506.81 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.61 MB, 116.61 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.67 MB (189441106) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.67 MB (189441106) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.67 MB (189441106) - DecompressionTime: 1s485ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.28 MB (148145952) - PerReadThreadRawHdfsThroughput: 1.15 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.79M (117791246) - RowsReturned: 117.79M (117791246) - RowsReturnedRate: 116.15 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.22K (1224) - ScannerThreadsTotalWallClockTime: 12s989ms - MaterializeTupleTime(*): 2s544ms - ScannerThreadsSysTime: 517.917ms - ScannerThreadsUserTime: 5s079ms - ScannerThreadsVoluntaryContextSwitches: 116.12K (116117) - TotalRawHdfsReadTime(*): 153.182ms - TotalReadThroughput: 116.61 MB/sec Instance a445907a420a80b6:e1f70fb800000005 (host=vb0234.halxg.cloudera.com:22000):(Total: 1s342ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB MemoryUsage(500.000ms): 138.97 MB, 139.12 MB, 34.38 MB ThreadUsage(500.000ms): 12, 12, 8 - AverageThreadTokens: 10.67 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.37 MB (146143016) - PerHostPeakMemUsage: 139.37 MB (146143016) - PrepareTime: 47.631ms - RowsProduced: 1 (1) - TotalCpuTime: 14s622ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 289.950us - TotalStorageWaitTime: 222.541ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.858ms, non-child: 72.858ms, % non-child: 100.00%) - CodegenTime: 674.930us - CompileTime: 8.565ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.018ms - PrepareTime: 46.707ms DataStreamSender (dst_id=2):(Total: 78.496us, non-child: 78.496us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 322.11 KB/sec - OverallThroughput: 199.05 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.234us - TransmitDataRPCTime: 48.508us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s340ms, non-child: 295.991ms, % non-child: 22.07%) ExecOption: Codegen Enabled - BuildTime: 183.275ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s044ms, non-child: 1s044ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 6:1/253.39 MB 9:2/506.82 MB 4:2/506.77 MB 7:2/506.79 MB 2:2/506.79 MB 10:4/1013.57 MB 3:2/479.24 MB 1:3/760.20 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 115.48 MB, 115.48 MB, 189.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.67 - BytesRead: 189.70 MB (198913222) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.70 MB (198913222) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.70 MB (198913222) - DecompressionTime: 1s528ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.34 MB (146106152) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.83M (123827522) - RowsReturned: 123.83M (123827522) - RowsReturnedRate: 118.50 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.27K (1273) - ScannerThreadsTotalWallClockTime: 13s477ms - MaterializeTupleTime(*): 2s580ms - ScannerThreadsSysTime: 609.902ms - ScannerThreadsUserTime: 5s229ms - ScannerThreadsVoluntaryContextSwitches: 114.10K (114102) - TotalRawHdfsReadTime(*): 128.842ms - TotalReadThroughput: 126.47 MB/sec Instance a445907a420a80b6:e1f70fb80000000a (host=vb0228.halxg.cloudera.com:22000):(Total: 1s296ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB MemoryUsage(500.000ms): 0, 137.05 MB, 61.06 MB ThreadUsage(500.000ms): 1, 12, 12 - AverageThreadTokens: 8.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 137.33 MB (143996704) - PerHostPeakMemUsage: 137.33 MB (143996704) - PrepareTime: 47.155ms - RowsProduced: 1 (1) - TotalCpuTime: 13s841ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 260.858us - TotalStorageWaitTime: 215.010ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.122ms, non-child: 72.122ms, % non-child: 100.00%) - CodegenTime: 840.944us - CompileTime: 7.894ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.369ms - PrepareTime: 46.325ms DataStreamSender (dst_id=2):(Total: 48.450us, non-child: 48.450us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 495.12 KB/sec - OverallThroughput: 322.50 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.184us - TransmitDataRPCTime: 31.558us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s295ms, non-child: 322.373ms, % non-child: 24.89%) ExecOption: Codegen Enabled - BuildTime: 199.498ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 972.755ms, non-child: 972.755ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 0:2/445.02 MB 3:1/253.40 MB 6:1/253.39 MB 1:1/253.41 MB 5:3/760.21 MB 9:1/253.39 MB 8:2/506.77 MB 7:2/506.81 MB 10:3/760.18 MB 2:2/506.82 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 114.10 MB, 124.70 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 188.32 MB (197467446) - BytesReadDataNodeCache: 0 - BytesReadLocal: 188.32 MB (197467446) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 188.32 MB (197467446) - DecompressionTime: 1s470ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 137.28 MB (143943456) - PerReadThreadRawHdfsThroughput: 1.38 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 122.89M (122890709) - RowsReturned: 122.89M (122890709) - RowsReturnedRate: 126.33 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1208) - ScannerThreadsTotalWallClockTime: 12s734ms - MaterializeTupleTime(*): 2s552ms - ScannerThreadsSysTime: 560.909ms - ScannerThreadsUserTime: 4s989ms - ScannerThreadsVoluntaryContextSwitches: 112.75K (112752) - TotalRawHdfsReadTime(*): 133.281ms - TotalReadThroughput: 124.70 MB/sec Instance a445907a420a80b6:e1f70fb800000002 (host=vb0214.halxg.cloudera.com:22000):(Total: 1s288ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB MemoryUsage(500.000ms): 139.02 MB, 83.02 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 139.33 MB (146102048) - PerHostPeakMemUsage: 139.33 MB (146102048) - PrepareTime: 45.724ms - RowsProduced: 1 (1) - TotalCpuTime: 13s823ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 250.050us - TotalStorageWaitTime: 244.710ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.433ms, non-child: 71.433ms, % non-child: 100.00%) - CodegenTime: 678.466us - CompileTime: 8.544ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.450ms - PrepareTime: 44.873ms DataStreamSender (dst_id=2):(Total: 41.164us, non-child: 41.164us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 851.41 KB/sec - OverallThroughput: 379.58 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.726us - TransmitDataRPCTime: 18.352us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s287ms, non-child: 281.760ms, % non-child: 21.89%) ExecOption: Codegen Enabled - BuildTime: 175.242ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 1s005ms, non-child: 1s005ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 10:2/506.78 MB 3:1/253.39 MB 0:1/253.39 MB 1:2/506.75 MB 6:1/253.37 MB 5:2/487.72 MB 9:1/253.39 MB 8:1/253.38 MB 7:3/760.21 MB 4:3/760.16 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 115.82 MB, 115.82 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 179.43 MB (188144203) - BytesReadDataNodeCache: 0 - BytesReadLocal: 179.43 MB (188144203) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 179.43 MB (188144203) - DecompressionTime: 1s510ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 10 (10) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 139.30 MB (146065184) - PerReadThreadRawHdfsThroughput: 1.22 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.14M (117138782) - RowsReturned: 117.14M (117138782) - RowsReturnedRate: 116.49 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.21K (1211) - ScannerThreadsTotalWallClockTime: 12s753ms - MaterializeTupleTime(*): 2s614ms - ScannerThreadsSysTime: 621.899ms - ScannerThreadsUserTime: 5s160ms - ScannerThreadsVoluntaryContextSwitches: 113.08K (113078) - TotalRawHdfsReadTime(*): 143.129ms - TotalReadThroughput: 115.82 MB/sec Instance a445907a420a80b6:e1f70fb80000000b (host=vb0206.halxg.cloudera.com:22000):(Total: 1s252ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB MemoryUsage(500.000ms): 140.91 MB, 53.13 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148191008) - PerHostPeakMemUsage: 141.33 MB (148191008) - PrepareTime: 47.682ms - RowsProduced: 1 (1) - TotalCpuTime: 13s564ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 523.775us - TotalStorageWaitTime: 228.064ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 73.381ms, non-child: 73.381ms, % non-child: 100.00%) - CodegenTime: 704.485us - CompileTime: 8.531ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.473ms - PrepareTime: 46.795ms DataStreamSender (dst_id=2):(Total: 60.089us, non-child: 60.089us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 395.75 KB/sec - OverallThroughput: 260.03 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 8.881us - TransmitDataRPCTime: 39.482us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s249ms, non-child: 280.626ms, % non-child: 22.45%) ExecOption: Codegen Enabled - BuildTime: 175.310ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 969.352ms, non-child: 969.352ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 0:1/253.39 MB 5:1/253.39 MB 4:2/506.78 MB 3:1/253.40 MB 1:1/253.39 MB 8:3/760.18 MB 2:3/760.18 MB 9:1/253.37 MB 6:2/506.80 MB 10:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.62 MB, 116.62 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 190.82 MB (200088922) - BytesReadDataNodeCache: 0 - BytesReadLocal: 190.82 MB (200088922) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 190.82 MB (200088922) - DecompressionTime: 1s406ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 11 (11) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.28 MB (148137760) - PerReadThreadRawHdfsThroughput: 1.18 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 124.58M (124580633) - RowsReturned: 124.58M (124580633) - RowsReturnedRate: 128.52 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.15K (1153) - ScannerThreadsTotalWallClockTime: 12s512ms - MaterializeTupleTime(*): 2s417ms - ScannerThreadsSysTime: 510.916ms - ScannerThreadsUserTime: 4s866ms - ScannerThreadsVoluntaryContextSwitches: 114.61K (114605) - TotalRawHdfsReadTime(*): 158.040ms - TotalReadThroughput: 116.62 MB/sec Instance a445907a420a80b6:e1f70fb800000004 (host=vb0230.halxg.cloudera.com:22000):(Total: 1s223ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB MemoryUsage(500.000ms): 141.15 MB, 52.97 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 48.000ms - RowsProduced: 1 (1) - TotalCpuTime: 13s060ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 233.844us - TotalStorageWaitTime: 220.955ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 74.156ms, non-child: 74.156ms, % non-child: 100.00%) - CodegenTime: 1.106ms - CompileTime: 8.496ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.986ms - PrepareTime: 47.103ms DataStreamSender (dst_id=2):(Total: 65.686us, non-child: 65.686us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 377.21 KB/sec - OverallThroughput: 237.87 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 7.748us - TransmitDataRPCTime: 41.422us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s222ms, non-child: 272.283ms, % non-child: 22.27%) ExecOption: Codegen Enabled - BuildTime: 169.357ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 950.561ms, non-child: 950.561ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:1/253.38 MB 5:1/253.38 MB 6:1/253.40 MB 0:2/506.78 MB 7:1/7.37 MB 8:4/1013.58 MB 4:4/1013.58 MB 9:3/760.20 MB 1:1/253.40 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 117.15 MB, 117.15 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.75 MB (189534707) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189534707) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189534707) - DecompressionTime: 1s505ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.27 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117849031) - RowsReturned: 117.85M (117849031) - RowsReturnedRate: 123.98 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.14K (1141) - ScannerThreadsTotalWallClockTime: 12s030ms - MaterializeTupleTime(*): 2s625ms - ScannerThreadsSysTime: 671.892ms - ScannerThreadsUserTime: 5s157ms - ScannerThreadsVoluntaryContextSwitches: 119.81K (119812) - TotalRawHdfsReadTime(*): 138.626ms - TotalReadThroughput: 117.15 MB/sec Instance a445907a420a80b6:e1f70fb80000000c (host=vb0220.halxg.cloudera.com:22000):(Total: 1s222ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB MemoryUsage(500.000ms): 141.14 MB, 61.05 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.35 MB (148215584) - PerHostPeakMemUsage: 141.35 MB (148215584) - PrepareTime: 47.510ms - RowsProduced: 1 (1) - TotalCpuTime: 12s795ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 288.282us - TotalStorageWaitTime: 200.692ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 72.764ms, non-child: 72.764ms, % non-child: 100.00%) - CodegenTime: 814.804us - CompileTime: 8.474ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.138ms - PrepareTime: 46.580ms DataStreamSender (dst_id=2):(Total: 68.918us, non-child: 68.918us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 407.35 KB/sec - OverallThroughput: 226.72 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 20.398us - TransmitDataRPCTime: 38.358us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s221ms, non-child: 251.491ms, % non-child: 20.59%) ExecOption: Codegen Enabled - BuildTime: 152.287ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 363.01 KB (371720) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 969.905ms, non-child: 969.905ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 16 out of 16 Hdfs split stats (:<# splits>/): 1:2/506.80 MB 10:1/253.39 MB 7:2/506.82 MB 8:1/253.38 MB 0:2/506.78 MB 4:2/506.78 MB 6:2/506.79 MB 2:4/1013.61 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:16 BytesRead(500.000ms): 116.64 MB, 116.64 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 169.66 MB (177904158) - BytesReadDataNodeCache: 0 - BytesReadLocal: 169.66 MB (177904158) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 169.66 MB (177904158) - DecompressionTime: 1s417ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 16 (16) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.31 MB (148178720) - PerReadThreadRawHdfsThroughput: 1.44 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 110.74M (110738860) - RowsReturned: 110.74M (110738835) - RowsReturnedRate: 114.17 M/sec - ScanRangesComplete: 16 (16) - ScannerThreadsInvoluntaryContextSwitches: 1.11K (1107) - ScannerThreadsTotalWallClockTime: 11s747ms - MaterializeTupleTime(*): 2s449ms - ScannerThreadsSysTime: 585.907ms - ScannerThreadsUserTime: 4s884ms - ScannerThreadsVoluntaryContextSwitches: 116.21K (116214) - TotalRawHdfsReadTime(*): 115.443ms - TotalReadThroughput: 116.64 MB/sec Instance a445907a420a80b6:e1f70fb80000000d (host=vb0224.halxg.cloudera.com:22000):(Total: 1s171ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB MemoryUsage(500.000ms): 141.00 MB, 53.15 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 44.722ms - RowsProduced: 1 (1) - TotalCpuTime: 12s570ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 530.638us - TotalStorageWaitTime: 237.379ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 70.385ms, non-child: 70.385ms, % non-child: 100.00%) - CodegenTime: 801.752us - CompileTime: 8.514ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.512ms - PrepareTime: 43.821ms DataStreamSender (dst_id=2):(Total: 52.844us, non-child: 52.844us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 495.65 KB/sec - OverallThroughput: 295.68 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 10.752us - TransmitDataRPCTime: 31.524us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s169ms, non-child: 258.841ms, % non-child: 22.13%) ExecOption: Codegen Enabled - BuildTime: 161.636ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 911.004ms, non-child: 911.004ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 10:2/506.82 MB 7:1/253.40 MB 2:2/506.80 MB 0:1/253.41 MB 1:3/760.18 MB 8:1/253.39 MB 5:4/987.82 MB 3:4/1013.57 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 116.63 MB, 116.63 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 189.80 MB (199018915) - BytesReadDataNodeCache: 0 - BytesReadLocal: 189.80 MB (199018915) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 189.80 MB (199018915) - DecompressionTime: 1s414ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.28 MB (148145952) - PerReadThreadRawHdfsThroughput: 1.33 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 123.88M (123876541) - RowsReturned: 123.88M (123876541) - RowsReturnedRate: 135.98 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 1.15K (1147) - ScannerThreadsTotalWallClockTime: 11s610ms - MaterializeTupleTime(*): 2s456ms - ScannerThreadsSysTime: 538.911ms - ScannerThreadsUserTime: 4s808ms - ScannerThreadsVoluntaryContextSwitches: 107.39K (107390) - TotalRawHdfsReadTime(*): 139.828ms - TotalReadThroughput: 116.63 MB/sec Instance a445907a420a80b6:e1f70fb800000001 (host=vb0212.halxg.cloudera.com:22000):(Total: 1s137ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB MemoryUsage(500.000ms): 140.59 MB, 140.90 MB, 42.74 MB ThreadUsage(500.000ms): 12, 12, 7 - AverageThreadTokens: 10.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.37 MB (148240168) - PerHostPeakMemUsage: 141.37 MB (148240168) - PrepareTime: 47.952ms - RowsProduced: 1 (1) - TotalCpuTime: 11s830ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 286.926us - TotalStorageWaitTime: 231.875ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 73.192ms, non-child: 73.192ms, % non-child: 100.00%) - CodegenTime: 806.326us - CompileTime: 8.485ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.189ms - PrepareTime: 46.957ms DataStreamSender (dst_id=2):(Total: 111.302us, non-child: 111.302us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 199.88 KB/sec - OverallThroughput: 140.38 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 22.036us - TransmitDataRPCTime: 78.172us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s136ms, non-child: 277.175ms, % non-child: 24.39%) ExecOption: Codegen Enabled - BuildTime: 164.315ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 859.246ms, non-child: 859.246ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 17 out of 17 Hdfs split stats (:<# splits>/): 7:1/253.39 MB 10:1/253.40 MB 1:3/760.20 MB 8:3/760.17 MB 6:3/760.20 MB 5:1/253.39 MB 4:3/760.20 MB 3:2/506.80 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:17 BytesRead(500.000ms): 116.63 MB, 116.63 MB, 180.24 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 9.33 - BytesRead: 180.24 MB (188991096) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.24 MB (188991096) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.24 MB (188991096) - DecompressionTime: 1s386ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 8 (8) - NumRowGroups: 17 (17) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.28 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.66M (117659771) - RowsReturned: 117.66M (117659771) - RowsReturnedRate: 136.93 M/sec - ScanRangesComplete: 17 (17) - ScannerThreadsInvoluntaryContextSwitches: 1.05K (1052) - ScannerThreadsTotalWallClockTime: 10s898ms - MaterializeTupleTime(*): 2s362ms - ScannerThreadsSysTime: 508.917ms - ScannerThreadsUserTime: 4s664ms - ScannerThreadsVoluntaryContextSwitches: 118.28K (118275) - TotalRawHdfsReadTime(*): 137.382ms - TotalReadThroughput: 120.16 MB/sec Instance a445907a420a80b6:e1f70fb800000008 (host=vb0232.halxg.cloudera.com:22000):(Total: 1s021ms, non-child: 0.000ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB MemoryUsage(500.000ms): 140.85 MB, 69.12 MB ThreadUsage(500.000ms): 12, 12 - AverageThreadTokens: 12.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 141.33 MB (148199200) - PerHostPeakMemUsage: 141.33 MB (148199200) - PrepareTime: 46.059ms - RowsProduced: 1 (1) - TotalCpuTime: 10s015ms - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 255.680us - TotalStorageWaitTime: 213.738ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - BytesWritten: 0 - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 80.00 GB (85899345920) - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalIntegrityCheckTime: 0.000ns - TotalReadBlockTime: 0.000ns CodeGen:(Total: 71.447ms, non-child: 71.447ms, % non-child: 100.00%) - CodegenTime: 800.948us - CompileTime: 8.556ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.86 MB (1953000) - NumFunctions: 18 (18) - NumInstructions: 297 (297) - OptimizationTime: 17.154ms - PrepareTime: 45.172ms DataStreamSender (dst_id=2):(Total: 46.736us, non-child: 46.736us, % non-child: 100.00%) - BytesSent: 16.00 B (16) - NetworkThroughput(*): 694.75 KB/sec - OverallThroughput: 334.32 KB/sec - RowsReturned: 1 (1) - SerializeBatchTime: 13.724us - TransmitDataRPCTime: 22.490us - UncompressedRowBatchSize: 16.00 B (16) AGGREGATION_NODE (id=1):(Total: 1s019ms, non-child: 254.274ms, % non-child: 24.93%) ExecOption: Codegen Enabled - BuildTime: 161.878ms - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 324.50 KB (332288) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) HDFS_SCAN_NODE (id=0):(Total: 765.570ms, non-child: 765.570ms, % non-child: 100.00%) ExecOption: Expr Evaluation Codegen Enabled, PARQUET Codegen Enabled, Codegen enabled: 18 out of 18 Hdfs split stats (:<# splits>/): 1:1/253.39 MB 4:3/760.17 MB 3:1/253.40 MB 5:2/506.80 MB 9:4/1013.56 MB 6:2/506.77 MB 7:2/506.77 MB 0:1/253.40 MB 10:2/260.88 MB Hdfs Read Thread Concurrency Bucket: 0:100% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% File Formats: PARQUET/SNAPPY:18 BytesRead(500.000ms): 117.14 MB, 138.34 MB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 11.00 - BytesRead: 180.75 MB (189526837) - BytesReadDataNodeCache: 0 - BytesReadLocal: 180.75 MB (189526837) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 180.75 MB (189526837) - DecompressionTime: 1s488ms - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDisksAccessed: 9 (9) - NumRowGroups: 18 (18) - NumScannerThreadsStarted: 11 (11) - PeakMemoryUsage: 141.30 MB (148162336) - PerReadThreadRawHdfsThroughput: 1.26 GB/sec - RemoteScanRanges: 0 (0) - RowsRead: 117.85M (117852239) - RowsReturned: 117.85M (117852239) - RowsReturnedRate: 153.94 M/sec - ScanRangesComplete: 18 (18) - ScannerThreadsInvoluntaryContextSwitches: 908 (908) - ScannerThreadsTotalWallClockTime: 9s181ms - MaterializeTupleTime(*): 2s655ms - ScannerThreadsSysTime: 396.934ms - ScannerThreadsUserTime: 4s749ms - ScannerThreadsVoluntaryContextSwitches: 76.78K (76777) - TotalRawHdfsReadTime(*): 139.994ms - TotalReadThroughput: 138.34 MB/sec ================================================================================