Query (id=b74143b67ec30ed2:a1220704cd8e58ac): Summary: Session ID: d248272d1d00c337:9e968c53149415a2 Session Type: BEESWAX Start Time: 2014-08-29 10:37:48.989425000 End Time: Query Type: QUERY Query State: CREATED Query Status: OK Impala Version: impalad version 1.3.1-cdh5 RELEASE (build 2cd2029d7e7871fdaa3b214d547a378205146f4c) User: pduser Network Address: ::ffff:127.0.0.1:52341 Default Db: default Sql Statement: select DISTINCT aDouble FROM bug_test_18356 Plan: ---------------- Estimated Per-Host Requirements: Memory=26.00MB VCores=2 F02:PLAN FRAGMENT [PARTITION=UNPARTITIONED] 04:EXCHANGE [PARTITION=UNPARTITIONED] hosts=1 per-host-mem=unavailable tuple-ids=1 row-size=8B cardinality=632 F01:PLAN FRAGMENT [PARTITION=HASH(aDouble)] DATASTREAM SINK [FRAGMENT=F02, EXCHANGE=04, PARTITION=UNPARTITIONED] 03:AGGREGATE [MERGE FINALIZE] | group by: aDouble | hosts=1 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=632 | 02:EXCHANGE [PARTITION=HASH(aDouble)] hosts=1 per-host-mem=0B tuple-ids=1 row-size=8B cardinality=632 F00:PLAN FRAGMENT [PARTITION=RANDOM] DATASTREAM SINK [FRAGMENT=F01, EXCHANGE=02, PARTITION=HASH(aDouble)] 01:AGGREGATE | group by: aDouble | hosts=1 per-host-mem=10.00MB | tuple-ids=1 row-size=8B cardinality=632 | 00:SCAN HDFS [default.bug_test_18356, PARTITION=RANDOM] partitions=2/2 size=37.71KB table stats: 2000 rows total column stats: all hosts=1 per-host-mem=16.00MB tuple-ids=0 row-size=8B cardinality=2000 ---------------- Estimated Per-Host Mem: 27262976 Estimated Per-Host VCores: 2 Admission result: Admitted immediately Request Pool: root.pduser Query Timeline: 25s225ms - Start execution: 1.933ms (1.933ms) - Planning finished: 14.470ms (12.537ms) - Submit for admission: 15.786ms (1.315ms) - Completed admission: 15.913ms (127.665us) ImpalaServer: - ClientFetchWaitTimer: 0ns - RowMaterializationTimer: 0ns Execution Profile b74143b67ec30ed2:a1220704cd8e58ac:(Total: 260.897ms, non-child: 0ns, % non-child: 0.00%) - FinalizationTimer: 0ns Coordinator Fragment: MemoryUsage(500.0ms): 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB, 8.00 KB ThreadUsage(500.0ms): 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 8.00 KB - PrepareTime: 22.628us - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 68.558ms, non-child: 0ns, % non-child: 0.00%) - CodegenTime: 0ns - CompileTime: 62.304ms - LoadTime: 5.423ms - ModuleFileSize: 101.10 KB EXCHANGE_NODE (id=4): BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DataArrivalWaitTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 1: split sizes: min: 0, max: 0, avg: 0, stddev: 0 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 48.00 KB - PrepareTime: 1.393ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 92.188ms, non-child: 92.188ms, % non-child: 100.00%) - CodegenTime: 1.330ms - CompileTime: 86.358ms - LoadTime: 5.130ms - ModuleFileSize: 101.10 KB DataStreamSender (dst_id=4):(Total: 18.158us, non-child: 18.158us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 8.00 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 1.385ms, non-child: 1.385ms, % non-child: 100.00%) - BuildBuckets: 0 - BuildTime: 0ns - GetResultsTime: 0ns - LoadFactor: 0.00 - PeakMemoryUsage: 32.00 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=2): - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DataArrivalWaitTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Averaged Fragment 2: split sizes: min: 37.71 KB, max: 37.71 KB, avg: 37.71 KB, stddev: 0 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 400.00 KB - PrepareTime: 1.307ms - RowsProduced: 0 - TotalCpuTime: 78.482ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 81.70ms CodeGen:(Total: 91.238ms, non-child: 91.238ms, % non-child: 100.00%) - CodegenTime: 1.145ms - CompileTime: 86.225ms - LoadTime: 4.343ms - ModuleFileSize: 101.10 KB DataStreamSender (dst_id=2):(Total: 15.644us, non-child: 15.644us, % non-child: 100.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 8.00 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 1.291ms, non-child: 0ns, % non-child: 0.00%) - BuildBuckets: 1.02K (1024) - BuildTime: 8s579ms - GetResultsTime: 0ns - LoadFactor: 0.65 - PeakMemoryUsage: 84.00 KB - RowsReturned: 0 - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 7s786ms, non-child: 7s786ms, % non-child: 100.00%) - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 45.64 KB - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 324.00 KB - PerReadThreadRawHdfsThroughput: 511.41 MB/sec - RowsRead: 368.27M (368268264) - RowsReturned: 368.26M (368262120) - RowsReturnedRate: 47.30 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 78.489ms - MaterializeTupleTime(*): 38.830us - ScannerThreadsSysTime: 68.989ms - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 87.159us - TotalReadThroughput: 2.26 KB/sec Fragment 1: Instance b74143b67ec30ed2:a1220704cd8e58ae (host=cdh5-dev.localdomain:22000): MemoryUsage(500.0ms): 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB, 48.00 KB ThreadUsage(500.0ms): 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1 - AverageThreadTokens: 1.00 - PeakMemoryUsage: 48.00 KB - PrepareTime: 1.393ms - RowsProduced: 0 - TotalCpuTime: 0ns - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 0ns CodeGen:(Total: 92.188ms, non-child: 0ns, % non-child: 0.00%) - CodegenTime: 1.330ms - CompileTime: 86.358ms - LoadTime: 5.130ms - ModuleFileSize: 101.10 KB DataStreamSender (dst_id=4):(Total: 18.158us, non-child: 0ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 8.00 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=3):(Total: 1.385ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 0 - BuildTime: 0ns - GetResultsTime: 0ns - LoadFactor: 0.00 - PeakMemoryUsage: 32.00 KB - RowsReturned: 0 - RowsReturnedRate: 0 EXCHANGE_NODE (id=2): BytesReceived(500.0ms): 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 - BytesReceived: 0 - ConvertRowBatchTime: 0ns - DataArrivalWaitTime: 0ns - DeserializeRowBatchTimer: 0ns - FirstBatchArrivalWaitTime: 0ns - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0ns - SendersBlockedTotalTimer(*): 0ns Fragment 2: Instance b74143b67ec30ed2:a1220704cd8e58af (host=cdh5-dev.localdomain:22000): Hdfs split stats (:<# splits>/): 0:2/37.71 KB MemoryUsage(500.0ms): 328.00 KB, 344.00 KB, 352.00 KB, 280.00 KB, 352.00 KB, 280.00 KB, 280.00 KB, 352.00 KB, 344.00 KB, 256.00 KB, 368.00 KB, 352.00 KB, 368.00 KB, 352.00 KB, 344.00 KB, 328.00 KB, 320.00 KB, 280.00 KB, 352.00 KB, 352.00 KB, 352.00 KB, 352.00 KB, 352.00 KB, 352.00 KB, 112.00 KB, 344.00 KB, 320.00 KB, 352.00 KB, 344.00 KB, 352.00 KB, 344.00 KB, 352.00 KB, 320.00 KB, 368.00 KB, 368.00 KB, 352.00 KB, 368.00 KB, 344.00 KB, 352.00 KB, 248.00 KB ThreadUsage(500.0ms): 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2 - AverageThreadTokens: 2.00 - PeakMemoryUsage: 400.00 KB - PrepareTime: 1.307ms - RowsProduced: 0 - TotalCpuTime: 78.482ms - TotalNetworkReceiveTime: 0ns - TotalNetworkSendTime: 0ns - TotalStorageWaitTime: 81.70ms CodeGen:(Total: 91.238ms, non-child: 0ns, % non-child: 0.00%) - CodegenTime: 1.145ms - CompileTime: 86.225ms - LoadTime: 4.343ms - ModuleFileSize: 101.10 KB DataStreamSender (dst_id=2):(Total: 15.644us, non-child: 0ns, % non-child: 0.00%) - BytesSent: 0 - NetworkThroughput(*): 0.00 /sec - OverallThroughput: 0.00 /sec - PeakMemoryUsage: 8.00 KB - SerializeBatchTime: 0ns - ThriftTransmitTime(*): 0ns - UncompressedRowBatchSize: 0 AGGREGATION_NODE (id=1):(Total: 1.291ms, non-child: 0ns, % non-child: 0.00%) ExecOption: Codegen Enabled - BuildBuckets: 1.02K (1024) - BuildTime: 8s579ms - GetResultsTime: 0ns - LoadFactor: 0.65 - PeakMemoryUsage: 84.00 KB - RowsReturned: 0 - RowsReturnedRate: 0 HDFS_SCAN_NODE (id=0):(Total: 7s786ms, non-child: 0ns, % non-child: 0.00%) Hdfs split stats (:<# splits>/): 0:2/37.71 KB BytesRead(500.0ms): 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB, 45.64 KB - AverageHdfsReadThreadConcurrency: 0.00 - AverageScannerThreadConcurrency: 1.00 - BytesRead: 45.64 KB - BytesReadDataNodeCache: 0 - BytesReadLocal: 0 - BytesReadShortCircuit: 0 - DecompressionTime: 0ns - NumColumns: 0 - NumDisksAccessed: 0 - NumScannerThreadsStarted: 2 - PeakMemoryUsage: 324.00 KB - PerReadThreadRawHdfsThroughput: 511.41 MB/sec - RowsRead: 368.27M (368268264) - RowsReturned: 368.26M (368262120) - RowsReturnedRate: 47.30 M/sec - ScanRangesComplete: 1 - ScannerThreadsInvoluntaryContextSwitches: 0 - ScannerThreadsTotalWallClockTime: 78.489ms - MaterializeTupleTime(*): 38.830us - ScannerThreadsSysTime: 68.989ms - ScannerThreadsUserTime: 0ns - ScannerThreadsVoluntaryContextSwitches: 3 - TotalRawHdfsReadTime(*): 87.159us - TotalReadThroughput: 2.26 KB/sec