Query (id=7e48d6aef231455b:1f7539efd0a62481) Summary Session ID: e24eea92efdbf62b:395e91fe8538ca9f Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-10-14 11:00:13.913747000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.1 RELEASE (build 27a4325c18c2a01c7a8097681a0eccf6d4335ea1) User: x194245 Connected User: x194245 Delegated User: Network Address: 48.24.145.193:57945 Default Db: retpocd01 Sql Statement: SELECT `v_univl_plan_dim`.`univl_plan_id`, `v_univl_plan_dim`.`yyyymm_key`, `v_univl_plan_dim`.`subplan_num` FROM `retpocd01`.`v_univl_plan_dim` `v_univl_plan_dim` WHERE ((`v_univl_plan_dim`.`subplan_num` IS NULL) AND (`v_univl_plan_dim`.`plan_num` = '763575')) Coordinator: paehowchq1d02.prudential.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=64.00MB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. retpocd01.v_univl_plan_dim 01:EXCHANGE [UNPARTITIONED] | hosts=2 per-host-mem=unavailable | tuple-ids=0 row-size=42B cardinality=unavailable | 00:SCAN HDFS [retpocd01.v_univl_plan_dim v_univl_plan_dim, RANDOM] partitions=1/1 files=2 size=9.92MB predicates: (v_univl_plan_dim.subplan_num IS NULL), (v_univl_plan_dim.plan_num = '763575') table stats: unavailable column stats: unavailable hosts=2 per-host-mem=64.00MB tuple-ids=0 row-size=42B cardinality=unavailable ---------------- Estimated Per-Host Mem: 67108864 Estimated Per-Host VCores: 1 Tables Missing Stats: retpocd01.v_univl_plan_dim Request Pool: root.retpocfad01 Admission result: Admitted immediately Planner Timeline Analysis finished: 1949393 Equivalence classes computed: 2190836 Single node plan created: 3838865 Runtime filters computed: 3880222 Distributed plan created: 4505866 Lineage info computed: 5103575 Planning finished: 7068333 Query Timeline Start execution: 71490 Planning finished: 9085898 Submit for admission: 9776555 Completed admission: 9897904 Ready to start 2 remote fragments: 10475128 All 2 remote fragments started: 14901908 Rows available: 496778028 ImpalaServer - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile 7e48d6aef231455b:1f7539efd0a62481 Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 2, 25th %-ile: 3ms, 50th %-ile: 3ms, 75th %-ile: 4ms, 90th %-ile: 4ms, 95th %-ile: 4ms, 99.9th %-ile: 4ms - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 486523721 Coordinator Fragment F01 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - PerHostPeakMemUsage: 0 - PrepareTime: 43780 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 481376021 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 481679235 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=1) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 481368753 - InactiveTotalTime: 481371914 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 481378521 Averaged Fragment F00 split sizes: min: 3.74 MB, max: 6.18 MB, avg: 4.96 MB, stddev: 1.22 MB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2141444 - PerHostPeakMemUsage: 2141444 - PrepareTime: 255589517 - RowsProduced: 0 - TotalCpuTime: 509748089 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 90 - TotalStorageWaitTime: 14206546 - TotalTime: 302031262 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 1844461 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1925128 - OptimizationTime: 174524554 - PrepareTime: 253138308 - TotalTime: 431136416 DataStreamSender (dst_id=1) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 2728 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 24716 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 778095 - BytesReadDataNodeCache: 0 - BytesReadLocal: 778095 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 778095 - DecompressionTime: 1405947 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2130524 - PerReadThreadRawHdfsThroughput: 443648293 - RemoteScanRanges: 0 - RowsRead: 124468 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 44875615 - MaterializeTupleTime(*): 27012760 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 29995000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 1789863 - TotalReadThroughput: 0 - TotalTime: 556222815 Fragment F00 Instance 7e48d6aef231455b:1f7539efd0a62483 (host=paehowchq1d03.prudential.com:22000) Hdfs split stats (:<# splits>/): 8:1/6.18 MB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 2626736 - PerHostPeakMemUsage: 2626736 - PrepareTime: 249076927 - RowsProduced: 0 - TotalCpuTime: 515500842 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 91 - TotalStorageWaitTime: 15817624 - TotalTime: 306322751 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 1825236 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1925128 - OptimizationTime: 166953621 - PrepareTime: 247127794 - TotalTime: 417176178 DataStreamSender (dst_id=1) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 2728 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 18847 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 8:1/6.18 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 937313 - BytesReadDataNodeCache: 0 - BytesReadLocal: 937313 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 937313 - DecompressionTime: 1877827 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 2615816 - PerReadThreadRawHdfsThroughput: 411068478 - RemoteScanRanges: 0 - RowsRead: 163705 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 55566372 - MaterializeTupleTime(*): 35536492 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 38994000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 2280187 - TotalReadThroughput: 0 - TotalTime: 553990170 Instance 7e48d6aef231455b:1f7539efd0a62484 (host=paehowchq1d01.prudential.com:22000) Hdfs split stats (:<# splits>/): 6:1/3.74 MB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 1656152 - PerHostPeakMemUsage: 1656152 - PrepareTime: 262102108 - RowsProduced: 0 - TotalCpuTime: 503995337 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 90 - TotalStorageWaitTime: 12595469 - TotalTime: 297739773 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 1863687 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1925128 - OptimizationTime: 182095488 - PrepareTime: 259148823 - TotalTime: 445096654 DataStreamSender (dst_id=1) - BytesSent: 0 - InactiveTotalTime: 0 - NetworkThroughput(*): 0 - OverallThroughput: 0 - PeakMemoryUsage: 2728 - RowsReturned: 0 - SerializeBatchTime: 0 - TotalTime: 30585 - TransmitDataRPCTime: 0 - UncompressedRowBatchSize: 0 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 6:1/3.74 MB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:4 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 618877 - BytesReadDataNodeCache: 0 - BytesReadLocal: 618877 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 618877 - DecompressionTime: 934068 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 4 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 1645232 - PerReadThreadRawHdfsThroughput: 476228108 - RemoteScanRanges: 0 - RowsRead: 85232 - RowsReturned: 0 - RowsReturnedRate: 0 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 34184859 - MaterializeTupleTime(*): 18489028 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 20996000 - ScannerThreadsVoluntaryContextSwitches: 7 - TotalRawHdfsReadTime(*): 1299539 - TotalReadThroughput: 0 - TotalTime: 558455461