Query (id=5f49bbf2f1ae64f0:21a3a4d029ec558d) Summary Session ID: f34171a6ed0dd445:64baf54513209f8f Session Type: HIVESERVER2 HiveServer2 Protocol Version: V6 Start Time: 2016-10-14 11:00:15.368899000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 2.5.0-cdh5.7.1 RELEASE (build 27a4325c18c2a01c7a8097681a0eccf6d4335ea1) User: x194245 Connected User: x194245 Delegated User: Network Address: 48.24.145.193:57949 Default Db: retpocd01 Sql Statement: SELECT `v_date_dim`.`yyyymm_key` FROM `retpocd01`.`v_date_dim` `v_date_dim` WHERE ((`v_date_dim`.`mth_in_yr_num` = 9) AND (`v_date_dim`.`yr_num` = 2015)) Coordinator: paehowchq1d02.prudential.com:22000 Query Options (non default): Plan: ---------------- Estimated Per-Host Requirements: Memory=48.00MB VCores=1 WARNING: The following tables are missing relevant table and/or column statistics. retpocd01.v_date_dim 01:EXCHANGE [UNPARTITIONED] | hosts=1 per-host-mem=unavailable | tuple-ids=0 row-size=12B cardinality=unavailable | 00:SCAN HDFS [retpocd01.v_date_dim v_date_dim, RANDOM] partitions=1/1 files=1 size=4.68KB predicates: (v_date_dim.mth_in_yr_num = 9), (v_date_dim.yr_num = 2015) table stats: unavailable column stats: unavailable hosts=1 per-host-mem=48.00MB tuple-ids=0 row-size=12B cardinality=unavailable ---------------- Estimated Per-Host Mem: 50331648 Estimated Per-Host VCores: 1 Tables Missing Stats: retpocd01.v_date_dim Request Pool: root.retpocfad01 Admission result: Admitted immediately Planner Timeline Analysis finished: 1310599 Equivalence classes computed: 1529747 Single node plan created: 2939623 Runtime filters computed: 2983032 Distributed plan created: 3604458 Lineage info computed: 4159457 Planning finished: 5490977 Query Timeline Start execution: 68980 Planning finished: 6674815 Submit for admission: 7240473 Completed admission: 7354554 Ready to start 1 remote fragments: 7884392 All 1 remote fragments started: 9351458 Rows available: 442308830 ImpalaServer - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile 5f49bbf2f1ae64f0:21a3a4d029ec558d Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node Targets Type Partition filter ----------------------------------------------------------- Fragment start latencies: Count: 1, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 434498530 Coordinator Fragment F01 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 12296 - PerHostPeakMemUsage: 0 - PrepareTime: 46376 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 432312975 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 432619029 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=1) - BytesReceived: 24 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 5932 - FirstBatchArrivalWaitTime: 432304079 - InactiveTotalTime: 432307050 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 432314839 Averaged Fragment F00 split sizes: min: 4.68 KB, max: 4.68 KB, avg: 4.68 KB, stddev: 0 - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 61440 - PerHostPeakMemUsage: 61440 - PrepareTime: 262283936 - RowsProduced: 1 - TotalCpuTime: 434068986 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 487859 - TotalStorageWaitTime: 8201626 - TotalTime: 272947269 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 1418347 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1925128 - OptimizationTime: 159101024 - PrepareTime: 260531450 - TotalTime: 422263678 DataStreamSender (dst_id=1) - BytesSent: 24 - InactiveTotalTime: 0 - NetworkThroughput(*): 438845 - OverallThroughput: 320696 - PeakMemoryUsage: 8192 - RowsReturned: 1 - SerializeBatchTime: 6672 - TotalTime: 74837 - TransmitDataRPCTime: 54689 - UncompressedRowBatchSize: 24 HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 6314 - BytesReadDataNodeCache: 0 - BytesReadLocal: 6314 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6314 - DecompressionTime: 10058 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 45056 - PerReadThreadRawHdfsThroughput: 85908268 - RemoteScanRanges: 0 - RowsRead: 204 - RowsReturned: 1 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 8877114 - MaterializeTupleTime(*): 55465 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 73497 - TotalReadThroughput: 0 - TotalTime: 533732234 Fragment F00 Instance 5f49bbf2f1ae64f0:21a3a4d029ec558f (host=paehowchq1d01.prudential.com:22000) Hdfs split stats (:<# splits>/): 12:1/4.68 KB - AverageThreadTokens: 1.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 61440 - PerHostPeakMemUsage: 61440 - PrepareTime: 262283936 - RowsProduced: 1 - TotalCpuTime: 434068986 - TotalNetworkReceiveTime: 0 - TotalNetworkSendTime: 487859 - TotalStorageWaitTime: 8201626 - TotalTime: 272947269 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 150323855360 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 CodeGen - CodegenTime: 0 - CompileTime: 1418347 - InactiveTotalTime: 0 - LoadTime: 0 - ModuleBitcodeSize: 1925128 - OptimizationTime: 159101024 - PrepareTime: 260531450 - TotalTime: 422263678 DataStreamSender (dst_id=1) - BytesSent: 24 - InactiveTotalTime: 0 - NetworkThroughput(*): 438845 - OverallThroughput: 320696 - PeakMemoryUsage: 8192 - RowsReturned: 1 - SerializeBatchTime: 6672 - TotalTime: 74837 - TransmitDataRPCTime: 54689 - UncompressedRowBatchSize: 24 HDFS_SCAN_NODE (id=0) ExecOption: Expr Evaluation Codegen Enabled, Codegen enabled: 0 out of 1 Hdfs split stats (:<# splits>/): 12:1/4.68 KB Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% 6:0% 7:0% 8:0% 9:0% 10:0% 11:0% 12:0% 13:0% 14:0% 15:0% 16:0% 17:0% 18:0% File Formats: PARQUET/SNAPPY:3 - AverageHdfsReadThreadConcurrency: 0.0 - AverageScannerThreadConcurrency: 0.0 - BytesRead: 6314 - BytesReadDataNodeCache: 0 - BytesReadLocal: 6314 - BytesReadRemoteUnexpected: 0 - BytesReadShortCircuit: 6314 - DecompressionTime: 10058 - InactiveTotalTime: 0 - MaxCompressedTextFileLength: 0 - NumColumns: 3 - NumDisksAccessed: 1 - NumRowGroups: 1 - NumScannerThreadsStarted: 1 - PeakMemoryUsage: 45056 - PerReadThreadRawHdfsThroughput: 85908268 - RemoteScanRanges: 0 - RowsRead: 204 - RowsReturned: 1 - RowsReturnedRate: 1 - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 1 - ScannerThreadsTotalWallClockTime: 8877114 - MaterializeTupleTime(*): 55465 - ScannerThreadsSysTime: 0 - ScannerThreadsUserTime: 0 - ScannerThreadsVoluntaryContextSwitches: 8 - TotalRawHdfsReadTime(*): 73497 - TotalReadThroughput: 0 - TotalTime: 533732234