Query (id=d74ebb73d679ddc0:3346e5d000000000) DEBUG MODE WARNING: Query profile created while running a DEBUG build of Impala. Use RELEASE builds to measure query performance. Summary Session ID: 274670c20978997e:c2512b64ccc717bf Session Type: BEESWAX Start Time: 2018-07-28 00:46:43.143375000 End Time: 2018-07-28 00:46:43.151399000 Query Type: QUERY Query State: FINISHED Query Status: OK Impala Version: impalad version 3.0.0-RELEASE DEBUG (build 671de258f29d31d280defe989af261fdbd9182ae) User: jenkins Connected User: jenkins Delegated User: Network Address: ::1:56046 Default Db: functional Sql Statement: select id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col from alltypesinsert where year=2009 and month=4 Coordinator: impala-ec2-centos74-m5-4xlarge-ondemand-1924.vpc.cloudera.com:22000 Query Options (set by configuration): ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0 Query Options (set by configuration and planner): ABORT_ON_ERROR=1,DISABLE_CODEGEN=1,EXEC_SINGLE_NODE_ROWS_THRESHOLD=0,MT_DOP=0,DISABLE_CODEGEN_ROWS_THRESHOLD=0 Plan: ---------------- Max Per-Host Resource Reservation: Memory=0B Per-Host Resource Estimates: Memory=10.00MB WARNING: The following tables are missing relevant table and/or column statistics. functional.alltypesinsert F01:PLAN FRAGMENT [UNPARTITIONED] hosts=1 instances=1 | Per-Host Resources: mem-estimate=0B mem-reservation=0B PLAN-ROOT SINK | mem-estimate=0B mem-reservation=0B | 01:EXCHANGE [UNPARTITIONED] | mem-estimate=0B mem-reservation=0B | tuple-ids=0 row-size=62B cardinality=0 | F00:PLAN FRAGMENT [RANDOM] hosts=1 instances=1 Per-Host Resources: mem-estimate=0B mem-reservation=0B 00:SCAN HDFS [functional.alltypesinsert, RANDOM] partitions=0/1 files=0 size=0B stored statistics: table: rows=unavailable size=unavailable partitions: 0/0 rows=unavailable columns missing stats: id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col extrapolated-rows=disabled mem-estimate=0B mem-reservation=0B tuple-ids=0 row-size=62B cardinality=0 ---------------- Estimated Per-Host Mem: 10485760 Tables Missing Stats: functional.alltypesinsert Per Host Min Reservation: impala-ec2-centos74-m5-4xlarge-ondemand-1924.vpc.cloudera.com:22000(0) Request Pool: default-pool Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ----------------------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 1.000ms 1.000ms 0 0 0 0 UNPARTITIONED 00:SCAN HDFS 1 0.000ns 0.000ns 0 0 0 0 functional.alltypesinsert Errors: - ComputeScanRangeAssignmentTimer: 0ns (0) - InactiveTotalTime: 0ns (0) - TotalTime: 0ns (0) Query Compilation Metadata of all 1 tables cached: 294.98us (294982) Analysis finished: 787.57us (787573) Value transfer graph computed: 861.50us (861497) Single node plan created: 1ms (1124717) Runtime filters computed: 1ms (1221695) Distributed plan created: 1ms (1245182) Planning finished: 1ms (1918495) Query Timeline Query submitted: 0ns (0) Planning finished: 2ms (2000028) Submit for admission: 3ms (3000042) Completed admission: 3ms (3000042) Ready to start on 1 backends: 3ms (3000042) All 1 execution backends (2 fragment instances) started: 4ms (4000056) Rows available: 5ms (5000070) First row fetched: 6ms (6000084) Last row fetched: 6ms (6000084) Released admission control resources: 6ms (6000084) Unregister query: 8ms (8000111) ImpalaServer - ClientFetchWaitTimer: 3ms (3000041) - InactiveTotalTime: 0ns (0) - RowMaterializationTimer: 0ns (0) - TotalTime: 0ns (0) Execution Profile d74ebb73d679ddc0:3346e5d000000000 Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Target type Partition filter Pending (Expected) First arrived Completed Enabled ------------------------------------------------------------------------------------------------------------------- Backend startup latencies: Count: 1, min / max: 1ms / 1ms, 25th %-ile: 1ms, 50th %-ile: 1ms, 75th %-ile: 1ms, 90th %-ile: 1ms, 95th %-ile: 1ms, 99.9th %-ile: 1ms Per Node Peak Memory Usage: impala-ec2-centos74-m5-4xlarge-ondemand-1924.vpc.cloudera.com:22000(17.94 KB) - FiltersReceived: 0 (0) - FinalizationTimer: 0ns (0) - InactiveTotalTime: 0ns (0) - NumBackends: 1 (1) - NumFragmentInstances: 2 (2) - NumFragments: 2 (2) - TotalTime: 1ms (1000014) Averaged Fragment F01 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1.000ms max:1.000ms mean: 1.000ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 8.0 KiB (8192) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 17.9 KiB (18368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1ms (1000014) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1ms (1000014) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 22.00us (22000) - TotalThreadsVoluntaryContextSwitches: 1 (1) - TotalTime: 1ms (1000014) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 0ns (0) - ExecTreeExecTime: 0ns (0) - InactiveTotalTime: 0ns (0) - OpenTime: 1ms (1000014) - ExecTreeOpenTime: 1ms (1000014) - PrepareTime: 0ns (0) - ExecTreePrepareTime: 0ns (0) - TotalTime: 0ns (0) PLAN_ROOT_SINK - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=1) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 1ms (1000014) DataStreamReceiver - BytesReceived: 0 B (0) - DeserializeRowBatchTimer: 0ns (0) - FirstBatchArrivalWaitTime: 1ms (1000014) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - SendersBlockedTimer: 0ns (0) - SendersBlockedTotalTimer(*): 0ns (0) - TotalTime: 0ns (0) Coordinator Fragment F01 Instance d74ebb73d679ddc0:3346e5d000000000 (host=impala-ec2-centos74-m5-4xlarge-ondemand-1924.vpc.cloudera.com:22000) - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 8.0 KiB (8192) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 17.9 KiB (18368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 1ms (1000014) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1ms (1000014) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 22.00us (22000) - TotalThreadsVoluntaryContextSwitches: 1 (1) - TotalTime: 1ms (1000014) Fragment Instance Lifecycle Event Timeline Prepare Finished: 0ns (0) Open Finished: 1ms (1000014) First Batch Produced: 1ms (1000014) First Batch Sent: 1ms (1000014) ExecInternal Finished: 1ms (1000014) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 0ns (0) - ExecTreeExecTime: 0ns (0) - InactiveTotalTime: 0ns (0) - OpenTime: 1ms (1000014) - ExecTreeOpenTime: 1ms (1000014) - PrepareTime: 0ns (0) - ExecTreePrepareTime: 0ns (0) - TotalTime: 0ns (0) PLAN_ROOT_SINK - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - TotalTime: 0ns (0) EXCHANGE_NODE (id=1) - ConvertRowBatchTime: 0ns (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 0 B (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - TotalTime: 1ms (1000014) DataStreamReceiver - BytesReceived: 0 B (0) - DeserializeRowBatchTimer: 0ns (0) - FirstBatchArrivalWaitTime: 1ms (1000014) - InactiveTotalTime: 1ms (1000014) - PeakMemoryUsage: 0 B (0) - SendersBlockedTimer: 0ns (0) - SendersBlockedTotalTimer(*): 0ns (0) - TotalTime: 0ns (0) Averaged Fragment F00 split sizes: min: 0, max: 0, avg: 0, stddev: 0 completion times: min:1.000ms max:1.000ms mean: 1.000ms stddev:0.000ns execution rates: min:0.00 /sec max:0.00 /sec mean:0.00 /sec stddev:0.00 /sec num instances: 1 - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 9.9 KiB (10176) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 17.9 KiB (18368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1ms (1000014) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 174.00us (174000) - TotalThreadsVoluntaryContextSwitches: 1 (1) - TotalTime: 1ms (1000014) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 1ms (1000014) - ExecTreeExecTime: 0ns (0) - InactiveTotalTime: 0ns (0) - OpenTime: 0ns (0) - ExecTreeOpenTime: 0ns (0) - PrepareTime: 0ns (0) - ExecTreePrepareTime: 0ns (0) - TotalTime: 0ns (0) DataStreamSender (dst_id=1) - BytesSent: 0 B (0) - InactiveTotalTime: 0ns (0) - NetworkThroughput(*): 0 B/s (0) - OverallThroughput: 0 B/s (0) - PeakMemoryUsage: 1.9 KiB (1984) - RowsReturned: 0 (0) - SerializeBatchTime: 0ns (0) - TotalTime: 0ns (0) - TransmitDataRPCTime: 0ns (0) - UncompressedRowBatchSize: 0 B (0) HDFS_SCAN_NODE (id=0) - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 0 B (0) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 0 B (0) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 0 B (0) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - InactiveTotalTime: 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 B (0) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0ns (0) - RowBatchQueuePutWaitTime: 0ns (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 0ns (0) - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 0ns (0) Fragment F00 Instance d74ebb73d679ddc0:3346e5d000000001 (host=impala-ec2-centos74-m5-4xlarge-ondemand-1924.vpc.cloudera.com:22000) - AverageThreadTokens: 0.00 (0.0) - BloomFilterBytes: 0 B (0) - InactiveTotalTime: 0ns (0) - PeakMemoryUsage: 9.9 KiB (10176) - PeakReservation: 0 B (0) - PeakUsedReservation: 0 B (0) - PerHostPeakMemUsage: 17.9 KiB (18368) - RowsProduced: 0 (0) - TotalNetworkReceiveTime: 0ns (0) - TotalNetworkSendTime: 0ns (0) - TotalStorageWaitTime: 0ns (0) - TotalThreadsInvoluntaryContextSwitches: 0 (0) - TotalThreadsTotalWallClockTime: 1ms (1000014) - TotalThreadsSysTime: 0ns (0) - TotalThreadsUserTime: 174.00us (174000) - TotalThreadsVoluntaryContextSwitches: 1 (1) - TotalTime: 1ms (1000014) Fragment Instance Lifecycle Event Timeline Prepare Finished: 0ns (0) Open Finished: 0ns (0) First Batch Produced: 1ms (1000014) First Batch Sent: 1ms (1000014) ExecInternal Finished: 1ms (1000014) Buffer pool - AllocTime: 0ns (0) - CumulativeAllocationBytes: 0 B (0) - CumulativeAllocations: 0 (0) - InactiveTotalTime: 0ns (0) - PeakReservation: 0 B (0) - PeakUnpinnedBytes: 0 B (0) - PeakUsedReservation: 0 B (0) - ReadIoBytes: 0 B (0) - ReadIoOps: 0 (0) - ReadIoWaitTime: 0ns (0) - ReservationLimit: 0 B (0) - TotalTime: 0ns (0) - WriteIoBytes: 0 B (0) - WriteIoOps: 0 (0) - WriteIoWaitTime: 0ns (0) Fragment Instance Lifecycle Timings - ExecTime: 1ms (1000014) - ExecTreeExecTime: 0ns (0) - InactiveTotalTime: 0ns (0) - OpenTime: 0ns (0) - ExecTreeOpenTime: 0ns (0) - PrepareTime: 0ns (0) - ExecTreePrepareTime: 0ns (0) - TotalTime: 0ns (0) DataStreamSender (dst_id=1) - BytesSent: 0 B (0) - InactiveTotalTime: 0ns (0) - NetworkThroughput(*): 0 B/s (0) - OverallThroughput: 0 B/s (0) - PeakMemoryUsage: 1.9 KiB (1984) - RowsReturned: 0 (0) - SerializeBatchTime: 0ns (0) - TotalTime: 0ns (0) - TransmitDataRPCTime: 0ns (0) - UncompressedRowBatchSize: 0 B (0) HDFS_SCAN_NODE (id=0) Hdfs split stats (:<# splits>/): ExecOption: Codegen Disabled: disabled by query option DISABLE_CODEGEN, Codegen enabled: 0 out of 0 Hdfs Read Thread Concurrency Bucket: 0:0% 1:0% 2:0% 3:0% 4:0% 5:0% - AverageHdfsReadThreadConcurrency: 0.00 (0.0) - AverageScannerThreadConcurrency: 0.00 (0.0) - BytesRead: 0 B (0) - BytesReadDataNodeCache: 0 B (0) - BytesReadLocal: 0 B (0) - BytesReadRemoteUnexpected: 0 B (0) - BytesReadShortCircuit: 0 B (0) - CachedFileHandlesHitCount: 0 (0) - CachedFileHandlesMissCount: 0 (0) - CollectionItemsRead: 0 (0) - InactiveTotalTime: 0ns (0) - MaxCompressedTextFileLength: 0 B (0) - NumDisksAccessed: 0 (0) - NumScannerThreadsStarted: 0 (0) - PeakMemoryUsage: 0 B (0) - PerReadThreadRawHdfsThroughput: 0 B/s (0) - RemoteScanRanges: 0 (0) - RowBatchQueueGetWaitTime: 0ns (0) - RowBatchQueuePutWaitTime: 0ns (0) - RowsRead: 0 (0) - RowsReturned: 0 (0) - RowsReturnedRate: 0 per second (0) - ScanRangesComplete: 0 (0) - ScannerThreadsInvoluntaryContextSwitches: 0 (0) - ScannerThreadsTotalWallClockTime: 0ns (0) - MaterializeTupleTime(*): 0ns (0) - ScannerThreadsSysTime: 0ns (0) - ScannerThreadsUserTime: 0ns (0) - ScannerThreadsVoluntaryContextSwitches: 0 (0) - TotalRawHdfsOpenFileTime(*): 0ns (0) - TotalRawHdfsReadTime(*): 0ns (0) - TotalReadThroughput: 0 B/s (0) - TotalTime: 0ns (0)