Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11109

Exhaustive tests fail in custom_cluster.test_permanent_udfs.py

    XMLWordPrintableJSON

Details

    • ghx-label-3

    Description

      Exhaustive test runs are failing when running custom_cluster/test_permanent_udfs.py, specifically TestUdfPersistence.test_corrupt_java_udf. Subsequent unrelated custom cluster tests fail with problems related to catalogd startup.

      It looks like catalog startup is failing with ClassNotFoundException:

      I0204 14:31:36.283778 18607 jni-util.cc:286] java.lang.NoClassDefFoundError: com/google/i18n/phonenumbers/NumberParseException
          at java.lang.Class.getDeclaredMethods0(Native Method)
          at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
          at java.lang.Class.privateGetPublicMethods(Class.java:2902)
          at java.lang.Class.getMethods(Class.java:1615)
          at org.apache.impala.hive.executor.HiveLegacyJavaFunction.extract(HiveLegacyJavaFunction.java:150)
          at org.apache.impala.catalog.CatalogServiceCatalog.loadJavaFunctions(CatalogServiceCatalog.java:1757)
          at org.apache.impala.catalog.CatalogServiceCatalog.invalidateDb(CatalogServiceCatalog.java:1862)
          at org.apache.impala.catalog.CatalogServiceCatalog.reset(CatalogServiceCatalog.java:1994)
          at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:167)
      Caused by: java.lang.ClassNotFoundException: com.google.i18n.phonenumbers.NumberParseException
          at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
          ... 9 more

      This is related to a special UDF we create for testing:

      https://github.com/apache/impala/blob/master/java/test-hive-udfs/src/main/java/org/apache/impala/UnresolvedUdf.java#L21

      I reproduced this locally by running:

      cd tests
      ./run-tests.py --skip-parallel --exploration_strategy=exhaustive custom_cluster/test_permanent_udfs.py

      It goes away if I revert the fix for IMPALA-10997, so it looks related to that.

      Attachments

        Issue Links

          Activity

            People

              scarlin Steve Carlin
              joemcdonnell Joe McDonnell
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: