[IMPALA-934] cached UDF libraries should be refreshed when a new function is created

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 1.3
• Fix Version/s: Impala 1.3.1
• Assignee: Skye Wanderman-Milne
• Reporter: Skye Wanderman-Milne
• Created: 03/Apr/14 18:21
• Updated: 01/May/14 23:51
• Resolved: 25/Apr/14 20:58

Description

Consider the following workflow:

1. Upload my_functions.so to HDFS
2. Create some UDFs using my_functions.so in Impala
3. Upload a new version of my_functions.so containing a new function to HDFS
4. Attempt to create the new UDF in Impala

Impala will throw a "Could not find function" AnalysisException because the impalad will not refresh the local cached copy of my_functions.so. Impala should always reload the library when a new function is created.

As a workaround, dropping one of the original functions will cause the cached copy to be dropped, and the new version be loaded when a function is created or one of the remaining functions is called.