[IMPALA-7351] Add memory estimates for plan nodes and sinks with missing estimates

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 3.4.0
• Component/s: Frontend
• Labels: admission-control resource-management
• Target Version: Product Backlog
• Epic Color: ghx-label-3
• Assignee: Bikramjeet Vig
• Reporter: Tim Armstrong
• Created: 25/Jul/18 22:48
• Updated: 10/Sep/19 17:12
• Resolved: 10/Sep/19 17:12

Description

Many plan nodes and sinks, e.g. KuduScanNode, KuduTableSink, ExchangeNode, etc are missing memory estimates entirely.

We should add a basic estimate for all these cases based on experiments and data from real workloads. In some cases 0 may be the right estimate (e.g. for streaming nodes like SelectNode that just pass through data) but we should remove TODOs and document the reasoning in those cases.

Issue Links

• depends upon: IMPALA-4268 Rework coordinator buffering to buffer more data