[IMPALA-7296] Soft limit for memory queue in scan node row batch queue

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.1.0
• Component/s: Backend
• Labels: resource-management
• Target Version: Impala 3.1.0
• Epic Color: ghx-label-4
• Assignee: Tim Armstrong
• Reporter: Tim Armstrong
• Created: 13/Jul/18 17:32
• Updated: 31/Jul/18 06:53
• Resolved: 31/Jul/18 06:53

Description

I'm splitting this out from IMPALA-7096.

It would be good to have some kind of soft limit for the amount of memory that can be queued in the scan node's row batch queue. This would make it easier to reason about the expected memory consumption of a scan.

Issue Links

• is related to: IMPALA-7096 Ensure no memory limit exceeded regressions from IMPALA-4835 because of non-reserved memory