[IMPALA-7356] Stress test for memory-based admission control

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: Impala 3.1.0
• Component/s: Infrastructure
• Labels: admission-control
• Epic Link: Memory-based admission control policies
• Target Version: Product Backlog
• Epic Color: ghx-label-8
• Assignee: Unassigned
• Reporter: Tim Armstrong
• Created: 25/Jul/18 23:06
• Updated: 21/Dec/20 19:22
• Resolved: 21/Dec/20 19:22

Description

We should extend the existing stress test to have a new mode designed to test memory-based admission control, where the stress test framework does not try to throttle memory consumption but instead relies on Impala doing so.

The required changes would be:

• A mode to disable throttling
• Options for stricter pass conditions - queries should not fail with OOM even if the stress test tries to submit way too many queries.
• However AC queue timeouts may be ok.
• Investigation into the logic for choosing which query to run next and when - does that need to change?

Issue Links

• breaks: IMPALA-7487 Failures in stress test when running against minicluster: "int() argument must be a string or a number, not 'NoneType'"

Sub-Tasks

• Report the number of currently queued queries in stress test: Resolved