Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12787

Concurrent DELETE and UPDATE operations on Iceberg tables can be problematic

    XMLWordPrintableJSON

Details

    • ghx-label-13

    Description

      If an UPDATE operation runs concurrently with a DELETE operation, and the DELETE commits first, then the UPDATE can revive deleted rows.

      This is because only RowDelta.validateNoConflictingDataFiles() is called, but RowDelta.validateNoConflictingDeleteFiles() is not. Therefore, the UPDATE operation ignores the concurrently written delete files.

      Attachments

        Issue Links

          Blocked

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12890 Concurrent Delete operations doesn't throw any error

          • Major - Major loss of function.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-12808 test_iceberg_deletes_and_updates failed by timeout error

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              boroknagyz Zoltán Borók-Nagy
              boroknagyz Zoltán Borók-Nagy
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: