Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-10453

HS2 leaking open file descriptors when using UDFs

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 1.2.1, 2.0.0
    • Component/s: UDF
    • Labels:
      None

      Description

      1. create a custom function by
      CREATE FUNCTION myfunc AS 'someudfclass' using jar 'hdfs:///tmp/myudf.jar';
      2. Create a simple jdbc client, just do
      connect,
      run simple query which using the function such as:
      select myfunc(col1) from sometable
      3. Disconnect.
      Check open file for HiveServer2 by:
      lsof -p HSProcID | grep myudf.jar
      You will see the leak as:

      java      28718 ychen  txt      REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
      java      28718 ychen  330r     REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
      

        Attachments

        1. HIVE-10453.1.patch
          4 kB
          Yongzhi Chen
        2. HIVE-10453.2.patch
          5 kB
          Yongzhi Chen

          Issue Links

            Activity

              People

              • Assignee:
                ychena Yongzhi Chen
                Reporter:
                ychena Yongzhi Chen
              • Votes:
                1 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: