[IMPALA-8762] Track number of running queries on all backends in admission controller

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 3.3.0
• Fix Version/s: Impala 4.1.0
• Component/s: Backend
• Labels: admission-control scalability
• Epic Color: ghx-label-8
• Assignee: Bikramjeet Vig
• Reporter: Lars Volker
• Created: 14/Jul/19 18:48
• Updated: 07/Mar/24 00:09
• Resolved: 29/Jul/21 01:43

Description

To support running multiple coordinators with executor groups and slot based admission checks, all executors need to include the number of currently running queries in their statestore updates, similar to mem reserved.

Issue Links

• causes: IMPALA-11659 Server network util of Statestored is much higher than impala-3.4