Query (id=224137a2b0394e1e:29128b40b6704898) Summary Session ID: 344e232e94e6bfa9:c790938140486881 Session Type: BEESWAX Start Time: 2018-09-27 14:29:42.959753000 End Time: 2018-09-27 14:29:46.612318000 Query Type: QUERY Query State: EXCEPTION Query Status: Memory limit exceeded HdfsParquetScanner::ReadDataPage() failed to allocate 270212389 bytes for dictionary. Impala Version: impalad version 2.6.0-cdh5.8.2 RELEASE (build f25aa5b2bcdabf1eb4233747a7b04a067059ee3b) User: utkarsh.saxena@FIREEYE.COM Connected User: utkarsh.saxena@FIREEYE.COM Delegated User: Network Address: 10.11.133.89:42300 Default Db: fenet5 Sql Statement: select * from hmig_os_changes_details_malicious where job_id = 55451 and uploaded_month = 201809 limit 2 Coordinator: labs-sca01-7-1-18.eng.fireeye.com:22000 Query Options (non default): MEM_LIMIT=21474836480 Plan: ---------------- Estimated Per-Host Requirements: Memory=288.00MB VCores=1 01:EXCHANGE [UNPARTITIONED] | limit: 2 | hosts=18 per-host-mem=unavailable | tuple-ids=0 row-size=245.78KB cardinality=1 | 00:SCAN HDFS [fenet5.hmig_os_changes_details_malicious, RANDOM] partitions=1/25 files=3168 size=114.02GB predicates: job_id = 55451 table stats: 40772434 rows total column stats: all limit: 2 hosts=18 per-host-mem=288.00MB tuple-ids=0 row-size=245.78KB cardinality=1 ---------------- Estimated Per-Host Mem: 301989888 Estimated Per-Host VCores: 1 Request Pool: root.DTI_Data_Content Admission result: Admitted immediately ExecSummary: Operator #Hosts Avg Time Max Time #Rows Est. #Rows Peak Mem Est. Peak Mem Detail ---------------------------------------------------------------------------------------------------------------------- 01:EXCHANGE 1 3s165ms 3s165ms 0 1 0 -1.00 B UNPARTITIONED 00:SCAN HDFS 0 0.000ns 0.000ns 0 1 0 288.00 MB fenet5.hmig_os_changes_deta... Planner Timeline Analysis finished: 1775819 Equivalence classes computed: 1916365 Single node plan created: 6436131 Runtime filters computed: 6454439 Distributed plan created: 7179683 Lineage info computed: 7605975 Planning finished: 8774489 Query Timeline Start execution: 163600 Planning finished: 23807760 Submit for admission: 32721688 Completed admission: 33024496 Ready to start 18 remote fragments: 35062560 All 18 remote fragments started: 48949344 Rows available: 3603956328 Unregister query: 3652501512 ImpalaServer - ClientFetchWaitTimer: 0 - InactiveTotalTime: 0 - RowMaterializationTimer: 0 - TotalTime: 0 Execution Profile 224137a2b0394e1e:29128b40b6704898 Number of filters: 0 Filter routing table: ID Src. Node Tgt. Node(s) Targets Target type Partition filter Pending (Expected) First arrived Completed ------------------------------------------------------------------------------------------------------------------- Fragment start latencies: Count: 18, 25th %-ile: 3ms, 50th %-ile: 4ms, 75th %-ile: 7ms, 90th %-ile: 7ms, 95th %-ile: 7ms, 99.9th %-ile: 7ms Per Node Peak Memory Usage: labs-sca01-8-2-34.eng.fireeye.com:22000(0) labs-sca01-8-2-38.eng.fireeye.com:22000(0) labs-sca01-7-1-36.eng.fireeye.com:22000(0) labs-sca01-7-1-24.eng.fireeye.com:22000(0) labs-sca01-7-1-32.eng.fireeye.com:22000(0) labs-sca01-8-2-36.eng.fireeye.com:22000(0) labs-sca01-7-1-38.eng.fireeye.com:22000(0) labs-sca01-8-2-22.eng.fireeye.com:22000(0) labs-sca01-7-1-34.eng.fireeye.com:22000(0) labs-sca01-8-2-18.eng.fireeye.com:22000(0) labs-sca01-7-1-22.eng.fireeye.com:22000(0) labs-sca01-8-2-24.eng.fireeye.com:22000(0) labs-sca01-7-1-20.eng.fireeye.com:22000(0) labs-sca01-8-2-20.eng.fireeye.com:22000(0) labs-sca01-7-1-30.eng.fireeye.com:22000(0) labs-sca01-7-1-18.eng.fireeye.com:22000(0) labs-sca01-8-2-32.eng.fireeye.com:22000(0) labs-sca01-8-2-30.eng.fireeye.com:22000(0) - FiltersReceived: 0 - FinalizationTimer: 0 - InactiveTotalTime: 0 - TotalTime: 3570102848 Coordinator Fragment F01 - AverageThreadTokens: 0.0 - BloomFilterBytes: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 8192 - PerHostPeakMemUsage: 0 - PrepareTime: 165088 - RowsProduced: 0 - TotalCpuTime: 0 - TotalNetworkReceiveTime: 3165206992 - TotalNetworkSendTime: 0 - TotalStorageWaitTime: 0 - TotalTime: 3166247992 BlockMgr - BlockWritesOutstanding: 0 - BlocksCreated: 0 - BlocksRecycled: 0 - BufferedPins: 0 - BytesWritten: 0 - InactiveTotalTime: 0 - MaxBlockSize: 8388608 - MemoryLimit: 17179869184 - PeakMemoryUsage: 0 - TotalBufferWaitTime: 0 - TotalEncryptionTime: 0 - TotalIntegrityCheckTime: 0 - TotalReadBlockTime: 0 - TotalTime: 0 EXCHANGE_NODE (id=1) - BytesReceived: 0 - ConvertRowBatchTime: 0 - DeserializeRowBatchTimer: 0 - FirstBatchArrivalWaitTime: 0 - InactiveTotalTime: 0 - PeakMemoryUsage: 0 - RowsReturned: 0 - RowsReturnedRate: 0 - SendersBlockedTimer: 0 - SendersBlockedTotalTimer(*): 0 - TotalTime: 3165210320 Averaged Fragment F00 split sizes: min: 6.28 GB, max: 6.37 GB, avg: 6.33 GB, stddev: 25.61 MB completion times: min:3s554ms max:3s562ms mean: 3s558ms stddev:2.150ms execution rates: min:1.77 GB/sec max:1.79 GB/sec mean:1.78 GB/sec stddev:6.50 MB/sec num instances: 18 Fragment F00 Instance 224137a2b0394e1e:29128b40b67048a3 (host=labs-sca01-8-2-32.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048ab (host=labs-sca01-8-2-34.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048aa (host=labs-sca01-8-2-38.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a9 (host=labs-sca01-7-1-36.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a8 (host=labs-sca01-8-2-36.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a7 (host=labs-sca01-7-1-32.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a6 (host=labs-sca01-7-1-24.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a5 (host=labs-sca01-8-2-30.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a4 (host=labs-sca01-7-1-18.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489a (host=labs-sca01-7-1-30.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a2 (host=labs-sca01-8-2-20.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a1 (host=labs-sca01-7-1-20.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b67048a0 (host=labs-sca01-8-2-22.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489f (host=labs-sca01-7-1-38.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489e (host=labs-sca01-7-1-34.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489d (host=labs-sca01-7-1-22.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489c (host=labs-sca01-8-2-18.eng.fireeye.com:22000) Instance 224137a2b0394e1e:29128b40b670489b (host=labs-sca01-8-2-24.eng.fireeye.com:22000)