Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4099

Improve error message while loading UDFs with a missing jar

    Details

      Description

      Right now, loading a UDF with a missing jar will give the following exception.

      E0829 15:04:21.130985 19471 CatalogServiceCatalog.java:508] Skipping function load: rank_2 
      Java exception follows: 
      java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 
      at java.util.ArrayList.rangeCheck(ArrayList.java:635) 
      at java.util.ArrayList.get(ArrayList.java:411) 
      at com.cloudera.impala.catalog.CatalogServiceCatalog.extractFunctions(CatalogServiceCatalog.java:402) 
      at com.cloudera.impala.catalog.CatalogServiceCatalog.loadJavaFunctions(CatalogServiceCatalog.java:503) 
      at com.cloudera.impala.catalog.CatalogServiceCatalog.reset(CatalogServiceCatalog.java:559) 
      at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:97)
      

      We can include a check for this and have a meaningful error message to improve supportability.

        Activity

        Hide
        bharathv bharath v added a comment -

        IMPALA-4099: Fix the error message while loading UDFs with no JARs
        Currently we throw a generic exception due to a missing check in
        the code for cases where the UDF has no resources associated with
        it. This is not super useful from supportability point of view.
        This commit fixes that. This also cleans up the code a little
        by moving these checks out of the extractFunctions() method.

        Change-Id: I167426ea96b0a41374227ef238b6f60e4184a9d7
        Reviewed-on: http://gerrit.cloudera.org:8080/4365
        Reviewed-by: Alex Behm <alex.behm@cloudera.com>
        Reviewed-by: Marcel Kornacker <marcel@cloudera.com>
        Tested-by: Internal Jenkins
        (cherry picked from commit 94fc6a3d07aaf19591b832d4fc88eee831db9f99)

        Show
        bharathv bharath v added a comment - IMPALA-4099 : Fix the error message while loading UDFs with no JARs Currently we throw a generic exception due to a missing check in the code for cases where the UDF has no resources associated with it. This is not super useful from supportability point of view. This commit fixes that. This also cleans up the code a little by moving these checks out of the extractFunctions() method. Change-Id: I167426ea96b0a41374227ef238b6f60e4184a9d7 Reviewed-on: http://gerrit.cloudera.org:8080/4365 Reviewed-by: Alex Behm <alex.behm@cloudera.com> Reviewed-by: Marcel Kornacker <marcel@cloudera.com> Tested-by: Internal Jenkins (cherry picked from commit 94fc6a3d07aaf19591b832d4fc88eee831db9f99)

          People

          • Assignee:
            bharathv bharath v
            Reporter:
            bharathv bharath v
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development