[IMPALA-10582] Webpage of Catalogd operations doesn't sum up operations correctly

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Impala 4.0.0
• Fix Version/s: Impala 4.0.0
• Component/s: Backend
• Epic Color: ghx-label-14
• Assignee: Quanlong Huang
• Reporter: Quanlong Huang
• Created: 12/Mar/21 07:54
• Updated: 01/Apr/21 08:25
• Resolved: 01/Apr/21 08:25

Description

IMPALA-6663 adds a web page for catalogd to show all in-progress operations. While doing a stree test for IMPALA-10563, I found that the summary tab doesn't sum up the operations as I expected.

As shown by the snapshot, I have 5 in-progress FINALIZE_INSERT_INTO operations. But in the "In-progress Catalog Operations Summary" tab, it shows 1. It makes sense to me to show 5 as well.

I think the reason is in be/src/catalog/catalog-server.cc, we only sum up requests by tables:

void CatalogServer::OperationUsageUrlCallback(
    const Webserver::WebRequest& req, Document* document) {
  ...
  // Create a summary and add it to the document
  map<string, int> aggregated_operations;
  for (const auto& catalog_op : opeartion_usage.catalog_op_counters) {
    ++aggregated_operations[catalog_op.catalog_op_name];  // <---- should add catalog_op.op_counter here
  }
  ...
}

 cc tmate

Issue Links

• links to: Gerrit