Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10692

Inserting to ACID tables are broken in local_catalog mode with hms event polling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 4.0.0
    • Fix Version/s: Impala 4.0.0
    • Component/s: Frontend
    • Labels:
      None
    • Epic Color:
      ghx-label-4

      Description

      https://gerrit.cloudera.org/#/c/17313/ broke the following simple workflow:

      bin/start-impala-cluster.py --catalogd_args="--hms_event_polling_interval_s=1 --catalog_topic_mode=minimal" --impalad_args="--use_local_catalog=1"
      
      set default_transactional_type=insert_only;
      create table tpa (i int) partitioned by (p int);
      insert into tpa partition (p=1) values(1);
      ERROR: NullPointerException: Invalid partition name: p=1
      

      The issue only occurs when inserting to a new partition in a partitioned table.

      From the catalogd log:

      I0430 19:18:03.091575 11521 jni-util.cc:286] java.lang.NullPointerException: Invalid partition name: p=1
              at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:897)
              at org.apache.impala.catalog.HdfsTable.getPartitionsForNames(HdfsTable.java:1657)
              at org.apache.impala.service.CatalogOpExecutor.createInsertEvents(CatalogOpExecutor.java:4921)
              at org.apache.impala.service.CatalogOpExecutor.updateCatalog(CatalogOpExecutor.java:4830)
              at org.apache.impala.service.JniCatalog.updateCatalog(JniCatalog.java:327)
      
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                csringhofer Csaba Ringhofer
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: