Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10582

Webpage of Catalogd operations doesn't sum up operations correctly

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: Impala 4.0.0
    • Fix Version/s: Impala 4.0.0
    • Component/s: Backend
    • Labels:
      None
    • Epic Color:
      ghx-label-14

      Description

      IMPALA-6663 adds a web page for catalogd to show all in-progress operations. While doing a stree test for IMPALA-10563, I found that the summary tab doesn't sum up the operations as I expected.

      As shown by the snapshot, I have 5 in-progress FINALIZE_INSERT_INTO operations. But in the "In-progress Catalog Operations Summary" tab, it shows 1. It makes sense to me to show 5 as well.

      I think the reason is in be/src/catalog/catalog-server.cc, we only sum up requests by tables:

      void CatalogServer::OperationUsageUrlCallback(
          const Webserver::WebRequest& req, Document* document) {
        ...
        // Create a summary and add it to the document
        map<string, int> aggregated_operations;
        for (const auto& catalog_op : opeartion_usage.catalog_op_counters) {
          ++aggregated_operations[catalog_op.catalog_op_name];  // <---- should add catalog_op.op_counter here
        }
        ...
      }
      

       cc Tamas Mate

        Attachments

        1. catalogd_operations.png
          121 kB
          Quanlong Huang

          Issue Links

            Activity

              People

              • Assignee:
                stigahuang Quanlong Huang
                Reporter:
                stigahuang Quanlong Huang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: