Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: Impala 2.7.0
    • Fix Version/s: Impala 2.9.0
    • Component/s: Backend
    • Labels:

      Description

      Currently impalads receive individual fragments that have their own self contained state.

      However, these fragments have state that is duplicated for each fragment. We could benefit from having this shared state in a query wide state that all fragments refer to during execution.

      This is the fundamental patch on top of which we need to implement a per query exec RPC, filter aggregation at different nodes across the cluster (not only the coordinator), per query reporting threads, etc.

        Issue Links

          Activity

          Hide
          marcelk Marcel Kornacker added a comment -

          commit 4b2d76dbb523c3761a6f53983b635ce88bc67a0c
          Author: Marcel Kornacker <marcel@cloudera.com>
          Date: Wed Oct 26 14:02:44 2016 -0700

          IMPALA-4014: Introduce query-wide execution state.

          This introduces a global structure to coordinate execution
          of fragment instances on a backend for a single query.

          New classes:

          • QueryExecMgr: subsumes FragmentMgr
          • QueryState
          • FragmentInstanceState: replaces FragmentExecState
          Show
          marcelk Marcel Kornacker added a comment - commit 4b2d76dbb523c3761a6f53983b635ce88bc67a0c Author: Marcel Kornacker <marcel@cloudera.com> Date: Wed Oct 26 14:02:44 2016 -0700 IMPALA-4014 : Introduce query-wide execution state. This introduces a global structure to coordinate execution of fragment instances on a backend for a single query. New classes: QueryExecMgr: subsumes FragmentMgr QueryState FragmentInstanceState: replaces FragmentExecState

            People

            • Assignee:
              marcelk Marcel Kornacker
              Reporter:
              sailesh Sailesh Mukil
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development