Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11108

Switch to add_write_notification_log_in_batch during inserts to ACID tables

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Catalog
    • ghx-label-12

    Description

      New api add_write_notification_log_in_batch() was added in HIVE-25205

      We could switch to using it here:
      https://github.com/apache/impala/blob/d59ec73990d89bfa4d4fa3d8fe598d53eb2918b7/fe/src/compat-hive-3/java/org/apache/impala/compat/MetastoreShim.java#L1115

      This would also need updating to a newer Hive dependency

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-11677 FireInsertEvents function can be very slow for tables with large number of partitions.

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              csringhofer Csaba Ringhofer
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: