[IMPALA-662] Frontend runs out of memory when generating many scan ranges

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 1.2
• Component/s: Frontend
• Labels: crash downgraded newbie ramp-up
• Target Version: Product Backlog
• Assignee: Unassigned
• Reporter: Skye Wanderman-Milne
• Created: 13/Nov/13 01:04
• Updated: 09/Oct/20 00:06

Description

When I set the scan range length to 2 bytes and queried a 200MB table, the frontend churned for several minutes (during which time I could not cancel the query) before the JVM ran out of memory and took down the impalad process. It would be nice if the frontend could somehow bail in this situation, or at least be cancellable. This is an extreme case and I'm not sure at what point the FE falls over, but this could theoretically be an issue with a sane scan range length and many files (or just a huge amount of data).