Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14433

refactor LLAP plan cache avoidance and fix issue in merge processor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.1, 2.1.1, 2.2.0
    • 2.1.1, 2.2.0
    • None
    • None

    Description

      Map and reduce processors do this:

          if (LlapProxy.isDaemon()) {
            cache = new org.apache.hadoop.hive.ql.exec.mr.ObjectCache(); // do not cache plan
      ...
      

      but merge processor just gets the plan. If it runs in LLAP, it can get a cached plan. Need to move this logic into ObjectCache itself, via a isPlan arg or something. That will also fix this issue for merge processor

      Attachments

        1. HIVE-14433.01.patch
          5 kB
          Sergey Shelukhin
        2. HIVE-14433.02.patch
          5 kB
          Sergey Shelukhin
        3. HIVE-14433.03.patch
          5 kB
          Sergey Shelukhin
        4. HIVE-14433.patch
          5 kB
          Sergey Shelukhin

        Activity

          People

            sershe Sergey Shelukhin
            sershe Sergey Shelukhin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: