Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23208

Update guaranteed capacity in ZK only when WM is enabled

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.0.0-alpha-1
    • llap
    • None

    Description

      https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskSchedulerService.java#L1091

       

      Though WM is not enabled, it ends up updating ZK for every dag completion event. For short running queries with concurrency, this ends up with lots of calls to ZK.

      It would be good to invoke this only when WM is enabled.

       

       

      Attachments

        1. HIVE-23208.1.patch
          1 kB
          Ramesh Kumar Thangarajan

        Activity

          People

            rameshkumar Ramesh Kumar Thangarajan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: