[IMPALA-11109] Exhaustive tests fail in custom_cluster.test_permanent_udfs.py

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: Impala 4.1.0
• Fix Version/s: Impala 4.1.0
• Component/s: Catalog, Frontend
• Labels: broken-build
• Epic Color: ghx-label-3
• Assignee: Steve Carlin
• Reporter: Joe McDonnell
• Created: 05/Feb/22 03:04
• Updated: 07/Apr/22 02:18
• Resolved: 07/Apr/22 02:18

Description

Exhaustive test runs are failing when running custom_cluster/test_permanent_udfs.py, specifically TestUdfPersistence.test_corrupt_java_udf. Subsequent unrelated custom cluster tests fail with problems related to catalogd startup.

It looks like catalog startup is failing with ClassNotFoundException:

I0204 14:31:36.283778 18607 jni-util.cc:286] java.lang.NoClassDefFoundError: com/google/i18n/phonenumbers/NumberParseException
    at java.lang.Class.getDeclaredMethods0(Native Method)
    at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
    at java.lang.Class.privateGetPublicMethods(Class.java:2902)
    at java.lang.Class.getMethods(Class.java:1615)
    at org.apache.impala.hive.executor.HiveLegacyJavaFunction.extract(HiveLegacyJavaFunction.java:150)
    at org.apache.impala.catalog.CatalogServiceCatalog.loadJavaFunctions(CatalogServiceCatalog.java:1757)
    at org.apache.impala.catalog.CatalogServiceCatalog.invalidateDb(CatalogServiceCatalog.java:1862)
    at org.apache.impala.catalog.CatalogServiceCatalog.reset(CatalogServiceCatalog.java:1994)
    at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:167)
Caused by: java.lang.ClassNotFoundException: com.google.i18n.phonenumbers.NumberParseException
    at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
    ... 9 more

This is related to a special UDF we create for testing:

https://github.com/apache/impala/blob/master/java/test-hive-udfs/src/main/java/org/apache/impala/UnresolvedUdf.java#L21

I reproduced this locally by running:

cd tests
./run-tests.py --skip-parallel --exploration_strategy=exhaustive custom_cluster/test_permanent_udfs.py

It goes away if I revert the fix for IMPALA-10997, so it looks related to that.

Issue Links

• relates to: IMPALA-10997 Refactor code for UDF implementation