Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23208

Update guaranteed capacity in ZK only when WM is enabled

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: llap
    • Labels:
      None

      Description

      https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskSchedulerService.java#L1091

       

      Though WM is not enabled, it ends up updating ZK for every dag completion event. For short running queries with concurrency, this ends up with lots of calls to ZK.

      It would be good to invoke this only when WM is enabled.

       

       

        Attachments

        1. HIVE-23208.1.patch
          1 kB
          Ramesh Kumar Thangarajan

          Activity

            People

            • Assignee:
              rameshkumar Ramesh Kumar Thangarajan
              Reporter:
              rajesh.balamohan Rajesh Balamohan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: