[IMPALA-7357] Consider lowering statestore update frequency further or adding jitter to admission controller

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Later
• Component/s: Backend
• Labels: admission-control
• Epic Link: Memory-based admission control policies
• Target Version: Impala 3.4.0
• Epic Color: ghx-label-2
• Assignee: Unassigned
• Reporter: Tim Armstrong
• Created: 25/Jul/18 23:10
• Updated: 17/Aug/19 23:00
• Resolved: 17/Aug/19 23:00

Description

We could consider reducing the update frequency further (maybe just for coordinators??) and possibly adding some jitter to the admission process to prevent overadmission when multiple queries are submitted at the same time to different coordinators.

The problem is that the coordinators independently make admission decisions before the change in state from previous decisions is propagated to other coordinators.

Sub-Tasks

• Add admission controller test that submits a burst of queries, triggering overadmission and query failure: Open