Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23208

Update guaranteed capacity in ZK only when WM is enabled

Log workAgile BoardRank to TopRank to BottomVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: llap
    • Labels:
      None

      Description

      https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskSchedulerService.java#L1091

       

      Though WM is not enabled, it ends up updating ZK for every dag completion event. For short running queries with concurrency, this ends up with lots of calls to ZK.

      It would be good to invoke this only when WM is enabled.

       

       

        Attachments

        1. HIVE-23208.1.patch
          1 kB
          Ramesh Kumar Thangarajan

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              rameshkumar Ramesh Kumar Thangarajan Assign to me
              Reporter:
              rajesh.balamohan Rajesh Balamohan

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment