Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2573

Create per-session function registry

    XMLWordPrintableJSON

Details

    • Incompatible change
    • Hide
      Marked as incompatible because of a bug -

      This patch broke automatic loading of externally added permanent functions in HiveServer2. This only affects multi-HS2 setup, where only one HS2 adds the function; or functions added from Hive CLI bypassing HS2. In such cases, HS2 will not be able to run a query with the new function.

      Additionally, RELOAD FUNCTION call has been broken by this patch.
      Workaround:
      The HS2s that don't have the function need to be restarted.
      Show
      Marked as incompatible because of a bug - This patch broke automatic loading of externally added permanent functions in HiveServer2. This only affects multi-HS2 setup, where only one HS2 adds the function; or functions added from Hive CLI bypassing HS2. In such cases, HS2 will not be able to run a query with the new function. Additionally, RELOAD FUNCTION call has been broken by this patch. Workaround: The HS2s that don't have the function need to be restarted.

    Description

      Currently the function registry is shared resource and could be overrided by other users when using HiveServer. If per-session function registry is provided, this situation could be prevented.

      Attachments

        1. ASF.LICENSE.NOT.GRANTED--HIVE-2573.D3231.1.patch
          54 kB
          Phabricator
        2. HIVE-2573.1.patch.txt
          46 kB
          Navis Ryu
        3. HIVE-2573.10.patch.txt
          141 kB
          Navis Ryu
        4. HIVE-2573.11.patch.txt
          147 kB
          Navis Ryu
        5. HIVE-2573.12.patch.txt
          144 kB
          Jason Dere
        6. HIVE-2573.13.patch.txt
          155 kB
          Navis Ryu
        7. HIVE-2573.14.patch.txt
          166 kB
          Navis Ryu
        8. HIVE-2573.15.patch.txt
          166 kB
          Navis Ryu
        9. HIVE-2573.2.patch.txt
          57 kB
          Navis Ryu
        10. HIVE-2573.3.patch.txt
          52 kB
          Navis Ryu
        11. HIVE-2573.4.patch.txt
          95 kB
          Navis Ryu
        12. HIVE-2573.5.patch
          99 kB
          Jason Dere
        13. HIVE-2573.6.patch
          114 kB
          Jason Dere
        14. HIVE-2573.7.patch
          120 kB
          Jason Dere
        15. HIVE-2573.8.patch.txt
          116 kB
          Navis Ryu
        16. HIVE-2573.9.patch.txt
          114 kB
          Navis Ryu

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-8218 function registry shared across sessions in HiveServer2

          • Major - Major loss of function.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13596 HS2 should be able to get UDFs on demand from metastore

          • Major - Major loss of function.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-2503 HiveServer should provide per session configuration

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HIVE-8218 function registry shared across sessions in HiveServer2

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-13043 Reload function has no impact to function registry

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-2544 Nullpointer on registering udfs.

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HIVE-11657 HIVE-2573 introduces some issues during metastore init (and CLI init)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-9095 permanent functions' ClassLoader should be global instead of per-session

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-13132 Hive should lazily load and cache metastore (permanent) functions

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link review board

          Activity

            People

              navis Navis Ryu
              navis Navis Ryu
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: