Query (id=7740f60e393a230e:2219a6c600000000): Summary: Session ID: d24120613b4e619a:e8d02c122e006098 Session Type: BEESWAX Start Time: 2017-04-12 02:16:55.259156000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.9.0-SNAPSHOT RELEASE (build 924ddc6e935aa6e6d2a07c4926cbb26ea0df0b4e) User: jenkins Connected User: jenkins Delegated User: Network Address: 127.0.0.1:39061 Default Db: functional_parquet Sql Statement: select count(*) from (select 1 FROM alltypes AS t1 JOIN alltypestiny AS t2 ON t1.string_col = t2.string_col UNION ALL SELECT 1 FROM tinytable AS t1) as t3 Coordinator: impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000 Query Options (non default): ABORT_ON_ERROR=1,BATCH_SIZE=10,MAX_BLOCK_MGR_MEMORY=0,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0 Plan: ---------------- Estimated Per-Host Requirements: Memory=2.03GB VCores=2 WARNING: The following tables are missing relevant table and/or column statistics. functional_parquet.alltypes, functional_parquet.alltypestiny, functional_parquet.tinytable PLAN-ROOT SINK | 08:AGGREGATE [FINALIZE] | output: count:merge(*) | hosts=3 per-host-mem=unavailable | tuple-ids=5 row-size=8B cardinality=0 | 07:EXCHANGE [UNPARTITIONED] | hosts=3 per-host-mem=unavailable | tuple-ids=5 row-size=8B cardinality=0 | 05:AGGREGATE | output: count(*) | hosts=3 per-host-mem=10.00MB | tuple-ids=5 row-size=8B cardinality=0 | 00:UNION | hosts=3 per-host-mem=0B | tuple-ids=3 row-size=0B cardinality=0 | |--04:SCAN HDFS [functional_parquet.tinytable t1, RANDOM] | partitions=1/1 files=1 size=465B | table stats: unavailable | column stats: all | hosts=1 per-host-mem=0B | tuple-ids=2 row-size=0B cardinality=unavailable | 03:HASH JOIN [INNER JOIN, BROADCAST] | hash predicates: t1.string_col = t2.string_col | runtime filters: RF000 <- t2.string_col | hosts=3 per-host-mem=2.00GB | tuple-ids=0,1 row-size=30B cardinality=unavailable | |--06:EXCHANGE [BROADCAST] | | hosts=3 per-host-mem=0B | | tuple-ids=1 row-size=15B cardinality=unavailable | | | 02:SCAN HDFS [functional_parquet.alltypestiny t2, RANDOM] | partitions=4/4 files=4 size=9.61KB | table stats: unavailable | column stats: unavailable | hosts=3 per-host-mem=16.00MB | tuple-ids=1 row-size=15B cardinality=unavailable | 01:SCAN HDFS [functional_parquet.alltypes t1, RANDOM] partitions=24/24 files=24 size=173.09KB runtime filters: RF000 -> t1.string_col table stats: unavailable column stats: unavailable hosts=3 per-host-mem=16.00MB tuple-ids=0 row-size=15B cardinality=unavailable ---------------- Estimated Per-Host Mem: 2174746624 Estimated Per-Host VCores: 2 Tables Missing Stats: functional_parquet.alltypes,functional_parquet.alltypestiny,functional_parquet.tinytable Request Pool: default-pool Admission result: Admitted immediately Planner Timeline: 2.816ms - Analysis finished: 1.067ms (1.067ms) - Equivalence classes computed: 1.149ms (81.946us) - Single node plan created: 2.051ms (901.844us) - Runtime filters computed: 2.155ms (104.275us) - Distributed plan created: 2.256ms (101.114us) - Planning finished: 2.816ms (559.887us) Query Timeline: 61h43m - Query submitted: 0.000ns (0.000ns) - Planning finished: 5.000ms (5.000ms) - Submit for admission: 6.000ms (1.000ms) - Completed admission: 6.000ms (0.000ns) - Ready to start 7 fragment instances: 8.000ms (2.000ms) - All 7 fragment instances started: 33.000ms (25.000ms) - ComputeScanRangeAssignmentTimer: 1.000ms ImpalaServer: - ClientFetchWaitTimer: 0.000ns - RowMaterializationTimer: 0.000ns Execution Profile 7740f60e393a230e:2219a6c600000000:(Total: 79.001ms, non-child: 0.000ns, % non-child: 0.00%) Number of filters: 1 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- 0 3 1 3 LOCAL false 0 (3) N/A N/A true Fragment instance start latencies: Count: 7, min / max: 6ms / 24ms, 25th %-ile: 6ms, 50th %-ile: 11ms, 75th %-ile: 13ms, 90th %-ile: 15ms, 95th %-ile: 24ms, 99.9th %-ile: 24ms - FiltersReceived: 0 (0) - FinalizationTimer: 0.000ns Coordinator Fragment F04: Instance 7740f60e393a230e:2219a6c600000000 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 69.001ms, non-child: 0.000ns, % non-child: 0.00%) MemoryUsage(1h8m): 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB, 16.16 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 16.17 KB (16560) - PerHostPeakMemUsage: 2.06 MB (2157313) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 608.008ms - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - ExecTreeOpenTime: 0.000ns - PrepareTime: 69.001ms - ExecTreePrepareTime: 1.000ms BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 16 (16) - BlocksRecycled: 2 (2) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 256.00 B (256) - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns PLAN_ROOT_SINK: - PeakMemoryUsage: 0 CodeGen:(Total: 68.000ms, non-child: 68.000ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 0 (0) - NumInstructions: 0 (0) - OptimizationTime: 0.000ns - PeakMemoryUsage: 0 - PrepareTime: 67.000ms AGGREGATION_NODE (id=8):(Total: 1.000ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 16.08 KB (16464) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=7):(Total: 594.008ms, non-child: 0.000ns, % non-child: 0.00%) BytesReceived(1h8m): 31.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B, 32.00 B - BytesReceived: 32.00 B (32) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 594.008ms - PeakMemoryUsage: 0 - RowsReturned: 2 (2) - RowsReturnedRate: 3.00 /sec - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns Averaged Fragment F03:(Total: 477.006ms, non-child: 29.333ms, % non-child: 6.15%) split sizes: min: 57.62 KB, max: 58.22 KB, avg: 57.85 KB, stddev: 272.37 B - AverageThreadTokens: 1.00 - BloomFilterBytes: 682.67 KB (699050) - PeakMemoryUsage: 1.86 MB (1951690) - PerHostPeakMemUsage: 1.87 MB (1962667) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 666.676us - TotalStorageWaitTime: 10.666ms - TotalThreadsInvoluntaryContextSwitches: 299 (299) - TotalThreadsTotalWallClockTime: 413.006ms - TotalThreadsSysTime: 5.331ms - TotalThreadsUserTime: 274.625ms - TotalThreadsVoluntaryContextSwitches: 60 (60) Fragment Instance Lifecycle Timings: - ExecTime: 1.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 397.005ms - ExecTreeOpenTime: 13.500ms - PrepareTime: 79.334ms - ExecTreePrepareTime: 333.338us DataStreamSender (dst_id=7): - BytesSent: 10.00 B (10) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 10.00 B (10) CodeGen:(Total: 438.339ms, non-child: 438.339ms, % non-child: 100.00%) - CodegenTime: 2.666ms - CompileTime: 109.001ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 89 (89) - NumInstructions: 2.99K (2994) - OptimizationTime: 969.014ms - PeakMemoryUsage: 1.46 MB (1532928) - PrepareTime: 55.334ms AGGREGATION_NODE (id=5):(Total: 9.333ms, non-child: 0.000ns, % non-child: 0.00%) - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 6.72 KB (6880) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 54.00 /sec - SpilledPartitions: 0 (0) UNION_NODE (id=0):(Total: 9.333ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 26.77 KB (27413) - RowsReturned: 1.30K (1299) - RowsReturnedRate: 106.30 K/sec HDFS_SCAN_NODE (id=4):(Total: 333.338us, non-child: 333.338us, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 155.00 B (155) - BytesReadDataNodeCache: 0 - BytesReadLocal: 232.00 B (232) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 232.00 B (232) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 0 (0) - NumRowGroups: 0 (0) - NumScannerThreadsStarted: 0 (0) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 368.00 B (368) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 333.338us - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1 (1) - RowsReturned: 1 (1) - RowsReturnedRate: 999.00 /sec - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 1 (1) - ScannerThreadsTotalWallClockTime: 333.338us - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 1 (1) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec HASH_JOIN_NODE (id=3):(Total: 9.333ms, non-child: 1.333ms, % non-child: 14.29%) - BuildRows: 5 (5) - BuildTime: 1.333ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 693.92 KB (710569) - ProbeRows: 324 (324) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 1.30K (1298) - RowsReturnedRate: 100.95 K/sec Hash Join Builder (join_node_id=3): - BuildRowsPartitionTime: 333.338us - BuildRowsPartitioned: 5 (5) - GetNewBlockTime: 0.000ns - HashBuckets: 10 (10) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 33 (33) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 10 (10) - PeakMemoryUsage: 682.88 KB (699268) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=6): - BytesReceived: 166.00 B (166) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 5 (5) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 8.000ms, non-child: 8.000ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 39.04 KB (39980) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.56 KB (59970) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.56 KB (59970) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 3 (3) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 143.08 KB (146513) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 7.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 1.62K (1623) - RowsReturned: 324 (324) - RowsReturnedRate: 28.84 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 23 (23) - ScannerThreadsTotalWallClockTime: 13.666ms - MaterializeTupleTime(*): 333.338us - ScannerThreadsSysTime: 666.000us - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 18 (18) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 1.62K (1623) - Rows rejected: 1.30K (1298) - Rows total: 1.62K (1623) Fragment F03: Instance 7740f60e393a230e:2219a6c600000006 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22002):(Total: 664.009ms, non-child: 32.000ms, % non-child: 4.82%) Hdfs split stats (:<# splits>/): 0:2/14.61 KB 2:3/21.48 KB 1:3/21.62 KB Filter 0 arrival: 655ms MemoryUsage(500.000ms): 1.49 MB ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 2.05 MB (2148809) - PerHostPeakMemUsage: 2.05 MB (2148809) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 20.000ms - TotalThreadsInvoluntaryContextSwitches: 426 (426) - TotalThreadsTotalWallClockTime: 612.008ms - TotalThreadsSysTime: 5.999ms - TotalThreadsUserTime: 407.938ms - TotalThreadsVoluntaryContextSwitches: 78 (78) Fragment Instance Lifecycle Timings: - ExecTime: 1.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 588.008ms - ExecTreeOpenTime: 8.000ms - PrepareTime: 75.001ms - ExecTreePrepareTime: 1.000ms DataStreamSender (dst_id=7): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 623.009ms, non-child: 623.009ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 159.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 88 (88) - NumInstructions: 2.97K (2968) - OptimizationTime: 410.005ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 52.000ms AGGREGATION_NODE (id=5):(Total: 9.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 8.08 KB (8272) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 111.00 /sec - SpilledPartitions: 0 (0) UNION_NODE (id=0):(Total: 9.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 40.16 KB (41120) - RowsReturned: 1.94K (1944) - RowsReturnedRate: 216.00 K/sec HDFS_SCAN_NODE (id=4): Hdfs split stats (:<# splits>/): Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% ExecOption: Codegen enabled: 0 out of 0 BytesRead(500.000ms): 0 - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 0 - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec HASH_JOIN_NODE (id=3):(Total: 10.000ms, non-child: 1.000ms, % non-child: 10.00%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 8 (8) - BuildTime: 1.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.02 MB (1065556) - ProbeRows: 486 (486) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 1.94K (1944) - RowsReturnedRate: 194.40 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 8 (8) - GetNewBlockTime: 0.000ns - HashBuckets: 16 (16) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 50 (50) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.00 MB (1048794) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=6): BytesReceived(500.000ms): 166.00 B - BytesReceived: 166.00 B (166) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 9.000ms, non-child: 9.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:2/14.61 KB 2:3/21.48 KB 1:3/21.62 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 1.250ms ; Min: 1.000ms ; Max: 2.000ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 58.54 KB (59940) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.54 KB (59940) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.54 KB (59940) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 4 (4) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 191.05 KB (195634) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.43K (2430) - RowsReturned: 486 (486) - RowsReturnedRate: 54.00 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 10 (10) - ScannerThreadsTotalWallClockTime: 22.000ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 34 (34) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 2.43K (2430) - Rows rejected: 1.94K (1944) - Rows total: 2.43K (2430) Instance 7740f60e393a230e:2219a6c600000004 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 678.009ms, non-child: 30.000ms, % non-child: 4.42%) Hdfs split stats (:<# splits>/): 0:5/29.50 KB 2:2/14.59 KB 1:2/14.13 KB Filter 0 arrival: 660ms MemoryUsage(500.000ms): 4.58 KB, 36.72 KB ThreadUsage(500.000ms): 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 1.00 MB (1048576) - PeakMemoryUsage: 2.05 MB (2149041) - PerHostPeakMemUsage: 2.06 MB (2157313) - RowsProduced: 1 (1) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 1.000ms - TotalStorageWaitTime: 12.000ms - TotalThreadsInvoluntaryContextSwitches: 473 (473) - TotalThreadsTotalWallClockTime: 627.009ms - TotalThreadsSysTime: 9.996ms - TotalThreadsUserTime: 415.937ms - TotalThreadsVoluntaryContextSwitches: 102 (102) Fragment Instance Lifecycle Timings: - ExecTime: 1.000ms - ExecTreeExecTime: 0.000ns - OpenTime: 603.008ms - ExecTreeOpenTime: 19.000ms - PrepareTime: 74.001ms - ExecTreePrepareTime: 0.000ns DataStreamSender (dst_id=7): - BytesSent: 16.00 B (16) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 1 (1) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 16.00 B (16) CodeGen:(Total: 629.009ms, non-child: 629.009ms, % non-child: 100.00%) - CodegenTime: 6.000ms - CompileTime: 168.002ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 91 (91) - NumInstructions: 3.05K (3046) - OptimizationTime: 406.005ms - PeakMemoryUsage: 1.49 MB (1559552) - PrepareTime: 49.000ms AGGREGATION_NODE (id=5):(Total: 19.000ms, non-child: 0.000ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 8.08 KB (8272) - RowsRepartitioned: 0 (0) - RowsReturned: 1 (1) - RowsReturnedRate: 52.00 /sec - SpilledPartitions: 0 (0) UNION_NODE (id=0):(Total: 19.000ms, non-child: 0.000ns, % non-child: 0.00%) - PeakMemoryUsage: 40.16 KB (41120) - RowsReturned: 1.96K (1955) - RowsReturnedRate: 102.89 K/sec HDFS_SCAN_NODE (id=4):(Total: 1.000ms, non-child: 1.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/465.00 B ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/NONE:1 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 1.000ms ; Min: 1.000ms ; Max: 1.000ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 465.00 B (465) - BytesReadDataNodeCache: 0 - BytesReadLocal: 465.00 B (465) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 465.00 B (465) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 0 (0) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 1.08 KB (1104) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 1.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 3 (3) - RowsReturned: 3 (3) - RowsReturnedRate: 3.00 K/sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 3 (3) - ScannerThreadsTotalWallClockTime: 1.000ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 3 (3) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec HASH_JOIN_NODE (id=3):(Total: 18.000ms, non-child: 3.000ms, % non-child: 16.67%) ExecOption: Probe Side Codegen Enabled, Join Build-Side Prepared Asynchronously - BuildRows: 8 (8) - BuildTime: 3.000ms - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 1.02 MB (1065556) - ProbeRows: 488 (488) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 1.95K (1952) - RowsReturnedRate: 108.44 K/sec Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled Runtime filters: 1 of 1 Runtime Filter Published - BuildRowsPartitionTime: 1.000ms - BuildRowsPartitioned: 8 (8) - GetNewBlockTime: 0.000ns - HashBuckets: 16 (16) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 50 (50) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 16 (16) - PeakMemoryUsage: 1.00 MB (1048794) - PinTime: 0.000ns - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) - UnpinTime: 0.000ns EXCHANGE_NODE (id=6): BytesReceived(500.000ms): 0, 166.00 B - BytesReceived: 166.00 B (166) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 8 (8) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1):(Total: 15.000ms, non-child: 15.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:4/29.05 KB 2:2/14.59 KB 1:2/14.13 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 8 out of 8 Runtime filters: All filters arrived. Waited 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:8 BytesRead(500.000ms): 0, 0 - FooterProcessingTime: (Avg: 875.013us ; Min: 0.000ns ; Max: 2.000ms ; Number of samples: 8) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 58.59 KB (60001) - BytesReadDataNodeCache: 0 - BytesReadLocal: 58.59 KB (60001) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 58.59 KB (60001) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 3 (3) - NumRowGroups: 8 (8) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 238.19 KB (243905) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 15.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2.44K (2440) - RowsReturned: 488 (488) - RowsReturnedRate: 32.53 K/sec - ScanRangesComplete: 8 (8) - ScannerThreadsInvoluntaryContextSwitches: 59 (59) - ScannerThreadsTotalWallClockTime: 19.000ms - MaterializeTupleTime(*): 1.000ms - ScannerThreadsSysTime: 1.998ms - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 21 (21) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 2.44K (2440) - Rows rejected: 1.95K (1952) - Rows total: 2.44K (2440) Instance 7740f60e393a230e:2219a6c600000005 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22001):(Total: 89.001ms, non-child: 26.000ms, % non-child: 29.21%) Hdfs split stats (:<# splits>/): 1:3/21.88 KB 2:2/14.45 KB 0:3/21.29 KB MemoryUsage(1h8m): 37.27 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB, 36.72 KB ThreadUsage(1h8m): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 1.49 MB (1557220) - PerHostPeakMemUsage: 1.51 MB (1581879) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 0.000ns - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 0.000ns - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 0.000ns - TotalThreadsVoluntaryContextSwitches: 0 (0) Fragment Instance Lifecycle Timings: - OpenTime: 0.000ns - PrepareTime: 89.001ms - ExecTreePrepareTime: 0.000ns DataStreamSender (dst_id=7): - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 16.00 KB (16384) - RowsReturned: 0 (0) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 0 CodeGen:(Total: 63.000ms, non-child: 63.000ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 0.000ns - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 88 (88) - NumInstructions: 2.97K (2968) - OptimizationTime: 2s091ms - PeakMemoryUsage: 1.45 MB (1519616) - PrepareTime: 65.000ms AGGREGATION_NODE (id=5): ExecOption: Codegen Enabled - BuildTime: 0.000ns - GetResultsTime: 0.000ns - HTResizeTime: 0.000ns - HashBuckets: 0 (0) - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 4.00 KB (4096) - RowsRepartitioned: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SpilledPartitions: 0 (0) UNION_NODE (id=0): - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=4): Hdfs split stats (:<# splits>/): BytesRead(1h8m): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - PeakMemoryUsage: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec HASH_JOIN_NODE (id=3): ExecOption: Probe Side Codegen Enabled - BuildRows: 0 (0) - BuildTime: 0.000ns - NumHashTableBuildsSkipped: 0 (0) - PeakMemoryUsage: 596.00 B (596) - ProbeRows: 0 (0) - ProbeRowsPartitioned: 0 (0) - ProbeTime: 0.000ns - RowsReturned: 0 (0) - RowsReturnedRate: 0 Hash Join Builder (join_node_id=3): ExecOption: Build Side Codegen Enabled, Hash Table Construction Codegen Enabled - BuildRowsPartitionTime: 0.000ns - BuildRowsPartitioned: 0 (0) - HashBuckets: 0 (0) - HashCollisions: 0 (0) - HashTablesBuildTime: 0.000ns - LargestPartitionPercent: 0 (0) - MaxPartitionLevel: 0 (0) - NumRepartitions: 0 (0) - PartitionsCreated: 0 (0) - PeakMemoryUsage: 218.00 B (218) - RepartitionTime: 0.000ns - SpilledPartitions: 0 (0) EXCHANGE_NODE (id=6): BytesReceived(1h8m): 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B, 166.00 B - BytesReceived: 166.00 B (166) - ConvertRowBatchTime: 0.000ns - DeserializeRowBatchTimer: 0.000ns - FirstBatchArrivalWaitTime: 0.000ns - PeakMemoryUsage: 0 - RowsReturned: 0 (0) - RowsReturnedRate: 0 - SendersBlockedTimer: 0.000ns - SendersBlockedTotalTimer(*): 0.000ns HDFS_SCAN_NODE (id=1): Hdfs split stats (:<# splits>/): 1:3/21.88 KB 2:2/14.45 KB 0:3/21.29 KB ExecOption: PARQUET Codegen Enabled BytesRead(1h8m): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesRead: 0 - PeakMemoryUsage: 0 - RowBatchQueueGetWaitTime: 0.000ns - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0.000ns - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalReadThroughput: 0.00 /sec Filter 0 (1.00 MB): - Rows processed: 0 (0) - Rows rejected: 0 (0) - Rows total: 0 (0) Averaged Fragment F01:(Total: 136.001ms, non-child: 47.334ms, % non-child: 34.80%) split sizes: min: 2.40 KB, max: 4.80 KB, avg: 3.20 KB, stddev: 1.13 KB - AverageThreadTokens: 0.33 - BloomFilterBytes: 0 - PeakMemoryUsage: 71.65 KB (73368) - PerHostPeakMemUsage: 1.54 MB (1619455) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4.666ms - TotalThreadsInvoluntaryContextSwitches: 14 (14) - TotalThreadsTotalWallClockTime: 81.001ms - TotalThreadsSysTime: 999.666us - TotalThreadsUserTime: 16.664ms - TotalThreadsVoluntaryContextSwitches: 17 (17) Fragment Instance Lifecycle Timings: - ExecTime: 21.000ms - ExecTreeExecTime: 18.333ms - OpenTime: 44.333ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 70.667ms - ExecTreePrepareTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=6): - BytesSent: 166.00 B (166) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 22.57 KB (23112) - RowsReturned: 2 (2) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 192.00 B (192) CodeGen:(Total: 70.334ms, non-child: 70.334ms, % non-child: 100.00%) - CodegenTime: 333.338us - CompileTime: 8.333ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 18.000ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 41.000ms HDFS_SCAN_NODE (id=2):(Total: 18.333ms, non-child: 18.333ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 3.27 KB (3350) - BytesReadDataNodeCache: 0 - BytesReadLocal: 3.27 KB (3350) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 3.27 KB (3350) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 18.61 KB (19057) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 141.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 2 (2) - ScannerThreadsTotalWallClockTime: 15.666ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Fragment F01: Instance 7740f60e393a230e:2219a6c600000002 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22001):(Total: 135.001ms, non-child: 47.000ms, % non-child: 34.81%) Hdfs split stats (:<# splits>/): 0:1/2.40 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 71.65 KB (73368) - PerHostPeakMemUsage: 1.51 MB (1581879) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 4.000ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 87.001ms - TotalThreadsSysTime: 0.000ns - TotalThreadsUserTime: 17.997ms - TotalThreadsVoluntaryContextSwitches: 14 (14) Fragment Instance Lifecycle Timings: - ExecTime: 22.000ms - ExecTreeExecTime: 16.000ms - OpenTime: 55.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 58.000ms - ExecTreePrepareTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=6): - BytesSent: 129.00 B (129) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 22.57 KB (23112) - RowsReturned: 2 (2) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 144.00 B (144) CodeGen:(Total: 72.001ms, non-child: 72.001ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 6.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 27.000ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 38.000ms HDFS_SCAN_NODE (id=2):(Total: 16.000ms, non-child: 16.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.40 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - FooterProcessingTime: (Avg: 1.000ms ; Min: 1.000ms ; Max: 1.000ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.45 KB (2513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 KB (2513) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 KB (2513) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 17.25 KB (17665) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 4.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 124.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 10.000ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 5 (5) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Instance 7740f60e393a230e:2219a6c600000001 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22002):(Total: 136.001ms, non-child: 50.000ms, % non-child: 36.76%) Hdfs split stats (:<# splits>/): 0:1/2.40 KB - AverageThreadTokens: 0.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 71.65 KB (73368) - PerHostPeakMemUsage: 1.54 MB (1614140) - RowsProduced: 2 (2) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 1.000ms - TotalThreadsInvoluntaryContextSwitches: 12 (12) - TotalThreadsTotalWallClockTime: 69.001ms - TotalThreadsSysTime: 1.999ms - TotalThreadsUserTime: 15.997ms - TotalThreadsVoluntaryContextSwitches: 13 (13) Fragment Instance Lifecycle Timings: - ExecTime: 16.000ms - ExecTreeExecTime: 15.000ms - OpenTime: 44.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 76.001ms - ExecTreePrepareTime: 0.000ns BlockMgr: - BlockWritesOutstanding: 0 (0) - BlocksCreated: 0 (0) - BlocksRecycled: 0 (0) - BufferedPins: 0 (0) - MaxBlockSize: 8.00 MB (8388608) - MemoryLimit: 14.31 GB (15365329920) - PeakMemoryUsage: 0 - ScratchBytesRead: 0 - ScratchBytesWritten: 0 - ScratchFileUsedBytes: 0 - ScratchReads: 0 (0) - ScratchWrites: 0 (0) - TotalBufferWaitTime: 0.000ns - TotalEncryptionTime: 0.000ns - TotalReadBlockTime: 0.000ns DataStreamSender (dst_id=6): - BytesSent: 126.00 B (126) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 22.57 KB (23112) - RowsReturned: 2 (2) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 144.00 B (144) CodeGen:(Total: 71.001ms, non-child: 71.001ms, % non-child: 100.00%) - CodegenTime: 0.000ns - CompileTime: 13.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 11.000ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 46.000ms HDFS_SCAN_NODE (id=2):(Total: 15.000ms, non-child: 15.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 0:1/2.40 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:1 - FooterProcessingTime: (Avg: 1.000ms ; Min: 1.000ms ; Max: 1.000ms ; Number of samples: 1) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 2.45 KB (2513) - BytesReadDataNodeCache: 0 - BytesReadLocal: 2.45 KB (2513) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 2.45 KB (2513) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 1 (1) - NumRowGroups: 1 (1) - NumScannerThreadsStarted: 1 (1) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 17.25 KB (17665) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 8.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 2 (2) - RowsReturned: 2 (2) - RowsReturnedRate: 133.00 /sec - ScanRangesComplete: 1 (1) - ScannerThreadsInvoluntaryContextSwitches: 8 (8) - ScannerThreadsTotalWallClockTime: 9.000ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 2 (2) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec Instance 7740f60e393a230e:2219a6c600000003 (host=impala-boost-static-burst-slave-1106.vpc.cloudera.com:22000):(Total: 137.002ms, non-child: 45.000ms, % non-child: 32.85%) Hdfs split stats (:<# splits>/): 2:1/2.40 KB 0:1/2.40 KB MemoryUsage(500.000ms): 0 ThreadUsage(500.000ms): 1 - AverageThreadTokens: 1.00 - BloomFilterBytes: 0 - PeakMemoryUsage: 71.65 KB (73368) - PerHostPeakMemUsage: 1.59 MB (1662348) - RowsProduced: 4 (4) - TotalNetworkReceiveTime: 0.000ns - TotalNetworkSendTime: 0.000ns - TotalStorageWaitTime: 9.000ms - TotalThreadsInvoluntaryContextSwitches: 16 (16) - TotalThreadsTotalWallClockTime: 87.001ms - TotalThreadsSysTime: 1.000ms - TotalThreadsUserTime: 15.998ms - TotalThreadsVoluntaryContextSwitches: 25 (25) Fragment Instance Lifecycle Timings: - ExecTime: 25.000ms - ExecTreeExecTime: 24.000ms - OpenTime: 34.000ms - ExecTreeOpenTime: 0.000ns - PrepareTime: 78.001ms - ExecTreePrepareTime: 0.000ns DataStreamSender (dst_id=6): - BytesSent: 243.00 B (243) - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 22.57 KB (23112) - RowsReturned: 4 (4) - SerializeBatchTime: 0.000ns - TransmitDataRPCTime: 0.000ns - UncompressedRowBatchSize: 288.00 B (288) CodeGen:(Total: 68.000ms, non-child: 68.000ms, % non-child: 100.00%) - CodegenTime: 1.000ms - CompileTime: 6.000ms - LoadTime: 0.000ns - ModuleBitcodeSize: 1.98 MB (2073156) - NumFunctions: 5 (5) - NumInstructions: 98 (98) - OptimizationTime: 16.000ms - PeakMemoryUsage: 49.00 KB (50176) - PrepareTime: 39.000ms HDFS_SCAN_NODE (id=2):(Total: 24.000ms, non-child: 24.000ms, % non-child: 100.00%) Hdfs split stats (:<# splits>/): 2:1/2.40 KB 0:1/2.40 KB ExecOption: PARQUET Codegen Enabled, Codegen enabled: 2 out of 2 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% File Formats: PARQUET/SNAPPY:2 BytesRead(500.000ms): 0 - FooterProcessingTime: (Avg: 4.000ms ; Min: 3.000ms ; Max: 5.000ms ; Number of samples: 2) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 0.00 - BytesRead: 4.91 KB (5026) - BytesReadDataNodeCache: 0 - BytesReadLocal: 4.91 KB (5026) - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 4.91 KB (5026) - DecompressionTime: 0.000ns - MaxCompressedTextFileLength: 0 - NumColumns: 1 (1) - NumDictFilteredRowGroups: 0 (0) - NumDisksAccessed: 2 (2) - NumRowGroups: 2 (2) - NumScannerThreadsStarted: 2 (2) - NumScannersWithNoReads: 0 (0) - NumStatsFilteredRowGroups: 0 (0) - PeakMemoryUsage: 21.33 KB (21841) - PerReadThreadRawHdfsThroughput: 0.00 /sec - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 6.000ms - RowBatchQueuePutWaitTime: 0.000ns - RowsRead: 4 (4) - RowsReturned: 4 (4) - RowsReturnedRate: 166.00 /sec - ScanRangesComplete: 2 (2) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 28.000ms - MaterializeTupleTime(*): 0.000ns - ScannerThreadsSysTime: 0.000ns - ScannerThreadsUserTime: 0.000ns - ScannerThreadsVoluntaryContextSwitches: 9 (9) - TotalRawHdfsReadTime(*): 0.000ns - TotalReadThroughput: 0.00 /sec