Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Impala 2.9.0
    • Component/s: Backend
    • Labels:
      None
    • Epic Color:
      ghx-label-7

      Description

      The fix for IMPALA-4041 added the ability to limit the set of nodes that can coordinate Impala queries and hence receive catalog updates. However, with this change coordinators can and will still participate in query execution. That may introduce in some cases significant load in the coordinator node. To address this issue, we should introduce another flag, termed is_executor, to exclude certain nodes from participating in query execution.

        Activity

        Hide
        dtsirogiannis Dimitris Tsirogiannis added a comment -

        Change-Id: I5d2ff7f341c9d2b0649e4d14561077e166ad7c4d
        Reviewed-on: http://gerrit.cloudera.org:8080/6628
        Reviewed-by: Dimitris Tsirogiannis <dtsirogiannis@cloudera.com>
        Tested-by: Impala Public Jenkins

        M be/src/scheduling/scheduler-test-util.cc
        M be/src/scheduling/scheduler-test-util.h
        M be/src/scheduling/scheduler-test.cc
        M be/src/scheduling/scheduler.cc
        M be/src/scheduling/scheduler.h
        M be/src/service/impala-http-handler.cc
        M be/src/service/impala-http-handler.h
        M be/src/service/impala-server.cc
        M be/src/service/impala-server.h
        M be/src/util/network-util.cc
        M be/src/util/webserver.cc
        M bin/start-impala-cluster.py
        M common/thrift/StatestoreService.thrift
        M tests/common/custom_cluster_test_suite.py
        M tests/custom_cluster/test_coordinators.py
        M www/backends.tmpl
        M www/root.tmpl
        17 files changed, 432 insertions, 307 deletions

        Approvals:
        Impala Public Jenkins: Verified
        Dimitris Tsirogiannis: Looks good to me, approved

        Show
        dtsirogiannis Dimitris Tsirogiannis added a comment - Change-Id: I5d2ff7f341c9d2b0649e4d14561077e166ad7c4d Reviewed-on: http://gerrit.cloudera.org:8080/6628 Reviewed-by: Dimitris Tsirogiannis <dtsirogiannis@cloudera.com> Tested-by: Impala Public Jenkins — M be/src/scheduling/scheduler-test-util.cc M be/src/scheduling/scheduler-test-util.h M be/src/scheduling/scheduler-test.cc M be/src/scheduling/scheduler.cc M be/src/scheduling/scheduler.h M be/src/service/impala-http-handler.cc M be/src/service/impala-http-handler.h M be/src/service/impala-server.cc M be/src/service/impala-server.h M be/src/util/network-util.cc M be/src/util/webserver.cc M bin/start-impala-cluster.py M common/thrift/StatestoreService.thrift M tests/common/custom_cluster_test_suite.py M tests/custom_cluster/test_coordinators.py M www/backends.tmpl M www/root.tmpl 17 files changed, 432 insertions , 307 deletions Approvals: Impala Public Jenkins: Verified Dimitris Tsirogiannis: Looks good to me, approved

          People

          • Assignee:
            dtsirogiannis Dimitris Tsirogiannis
            Reporter:
            dtsirogiannis Dimitris Tsirogiannis
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development