Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2990 Coordinator should timeout and cancel queries with unresponsive / stuck executors
  3. IMPALA-4063

Make fragment instance reports per-query (or per-host) instead of per-fragment instance.

    XMLWordPrintableJSON

    Details

      Description

      Currently we send a report per-fragment instance to the coordinator every 5 seconds (by default; modifiable via query option 'status_report_interval').

      For queries with a large number of fragment instances, this generates tremendous amounts of network traffic to the coordinator, which will only be aggravated with higher a DOP.

      We should instead queue per-fragment instance reports and send out a per-query report to the coordinator instead.

      For code references, see:
      PlanFragmentExecutor:: ReportProfile()
      PlanFragmentExecutor:: SendReport()
      FragmentExecState:: ReportStatusCb()

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                kwho Michael Ho
                Reporter:
                sailesh Sailesh Mukil
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: