[IMPALA-8126] Move per-host resource utilization counters to per-host profiles in coordinator

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: Impala 3.2.0
• Component/s: Backend
• Labels: observability profile supportability
• Epic Link: Improve Impala Profile User Experience
• Target Version: Impala 4.3.0
• Epic Color: ghx-label-1
• Assignee: Unassigned
• Reporter: Lars Volker
• Created: 26/Jan/19 02:27
• Updated: 23/Nov/22 12:22

Description

Once IMPALA-7694 gets in we should move the per-host resource utilization counters in Coordinator::ComputeQuerySummary() to the host profiles in Coordinator::BackendState.

tarmstrong pointed out here:

We could also simplify BackendState::ComputeResourceUtilization() to just use the per-backend counters instead of iterating over fragments.

I think there may be some compatibility concerns about removing these - existence of the counters isn't contractual but we don't want to break useful tools if avoidable.

For example, I confirmed that Cloudera Manager actually does parse the existing strings (which is a little sad, but understandable given the lack of other counters).