Query (id=b43e9db670cf667:38e3629a00000000) Summary Session ID: a342082c512e7a79:d6a7e7fdac4672a8 Session Type: BEESWAX Start Time: 2016-12-01 15:01:26.090737000 End Time: 2016-12-01 15:01:26.428252000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 2.7.0-cdh5.9.1 RELEASE (build b5354a4da4cd2b7fd198273ecdc0b16fca2d67df) User: certtoolkitqa@AD.HALXG.CLOUDERA.COM Connected User: certtoolkitqa@AD.HALXG.CLOUDERA.COM Delegated User: Network Address: ::ffff:172.26.13.245:40785 Default Db: default Sql Statement: select * from sample_07 as random1 Coordinator: certtoolkit-balsam-2.vpc.cloudera.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=32.00MB VCores=1 WARNING: The following tables have potentially corrupt table statistics. Drop and re-compute statistics to resolve this problem. default.sample_07 WARNING: The following tables are missing relevant table and/or column statistics. default.sample_07 01:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=0 row-size=38B cardinality=0 | 00:SCAN HDFS [default.sample_07 random1, RANDOM] partitions=1/1 files=1 size=44.98KB table stats: 0 rows total column stats: unavailable hosts=1 per-host-mem=32.00MB tuple-ids=0 row-size=38B cardinality=0 ---------------- Estimated Per-Host Mem: 33554432 Estimated Per-Host VCores: 1 Tables Missing Stats: default.sample_07 Tables With Corrupt Table Stats: default.sample_07 Request Pool: root.certtoolkitqa Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ------------------------------------------------------------------------------------------------------------------ 01:EXCHANGE 1 0.000ns 0.000ns 823 0 0 -1.00 B UNPARTITIONED 00:SCAN HDFS 1 51.001ms 51.001ms 823 0 188.00 KB 32.00 MB default.sample_07 random1 - ComputeScanRangeAssignmentTimer: 0 - InactiveTotalTime: 0 - TotalTime: 0 Planner Timeline Analysis finished: 2801827 Equivalence classes computed: 3070051 Single node plan created: 4879045 Runtime filters computed: 4924397 Distributed plan created: 6032125 Lineage info computed: 7091404 Planning finished: 9450371 Query Timeline Start execution: 0 Planning finished: 10999922 Submit for admission: 11999915 Completed admission: 11999915 Ready to start 1 remote fragments: 11999915 All 1 remote fragments started: 12999908 Rows available: 121999135 First row fetched: 216998460 Unregister query: 336997607 ImpalaServer - ClientFetchWaitTimer: 213998479 - InactiveTotalTime: 0 - RowMaterializationTimer: 999993 - TotalTime: 0 Execution Profile b43e9db670cf667:38e3629a00000000 Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed Enabled ---------------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 1, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: certtoolkit-balsam-4.vpc.cloudera.com:22000(198.66 KB) certtoolkit-balsam-2.vpc.cloudera.com:22000(0) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 109999220 Coordinator Fragment F01 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 88592 - PerHostPeakMemUsage: 0 - PrepareTime: 0 - RowsProduced: 0 - TotalCpuTime: 95999318 - TotalNetworkReceiveTime: 108999227 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 108999227 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 10769950720 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=1) - BytesReceived: 40557 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 108999227 - InactiveTotalTime: 108999227 - PeakMemoryUsage: 0 - RowsReturned: 823 - RowsReturnedRate: 7550 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 108999227 Averaged Fragment F00 split sizes: min: 44.98 KB, max: 44.98 KB, avg: 44.98 KB, stddev: 0 completion times: min:109.999ms max:109.999ms mean: 109.999ms stddev:0.000ns execution rates: min:408.87 KB/sec max:408.87 KB/sec mean:408.87 KB/sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 203432 - PerHostPeakMemUsage: 203432 - PrepareTime: 34000815 - RowsProduced: 823 - TotalCpuTime: 109002611 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1000024 - TotalStorageWaitTime: 17000407 - TotalTime: 53001270 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 10769950720 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2000046 - CompileTime: 16000383 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1984068 - NumFunctions: 22 - NumInstructions: 373 - OptimizationTime: 40000958 - PrepareTime: 33000792 - TotalTime: 90002157 DataStreamSender (dst_id=1) - BytesSent: 40557 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 40556026 - RowsReturned: 823 - SerializeBatchTime: 1000024 - TotalTime: 1000024 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 77111 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 46055 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46055 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46055 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 192512 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 823 - RowsReturned: 823 - RowsReturnedRate: 16136 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 17000407 - DelimiterParseTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 51001222 Fragment F00 Instance b43e9db670cf667:38e3629a00000001 (host=certtoolkit-balsam-4.vpc.cloudera.com:22000) Hdfs split stats (:<# splits>/): 0:1/44.98 KB - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 203432 - PerHostPeakMemUsage: 203432 - PrepareTime: 34000815 - RowsProduced: 823 - TotalCpuTime: 109002611 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 1000024 - TotalStorageWaitTime: 17000407 - TotalTime: 53001270 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 10769950720 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 2000046 - CompileTime: 16000383 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1984068 - NumFunctions: 22 - NumInstructions: 373 - OptimizationTime: 40000958 - PrepareTime: 33000792 - TotalTime: 90002157 DataStreamSender (dst_id=1) - BytesSent: 40557 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 40556026 - RowsReturned: 823 - SerializeBatchTime: 1000024 - TotalTime: 1000024 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 77111 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Disabled, TEXT Codegen Enabled, Codegen enabled: 1 out of 1 Hdfs split stats (:<# splits>/): 0:1/44.98 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% File Formats: TEXT/NONE:1 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 46055 - BytesReadDataNodeCache: 0 - BytesReadLocal: 46055 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 46055 - DecompressionTime: 0 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumDisksAccessed: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 192512 - PerReadThreadRawHdfsThroughput: 0 - RemoteScanRanges: 0 - RowsRead: 823 - RowsReturned: 823 - RowsReturnedRate: 16136 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 17000407 - DelimiterParseTime: 0 - MaterializeTupleTime(*): 0 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 9 - TotalRawHdfsReadTime(*): 0 - TotalReadThroughput: 0 - TotalTime: 51001222