Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8452

Possible Suppress buffer optimization: de-duplicate prior value

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.4.0
    • streams
    • None

    Description

      As of KAFKA-8199, the suppression buffers have to track the "prior value" in addition to the "old" and "new" values for each record, to support transparent downstream views.

      In many cases, the prior value is actually the same as the old value, and we could avoid storing it separately. The challenge is that the old and new values are already serialized into a common array (as a Change via the FullChangeSerde), so the "prior" value would actually be a slice on the underlying array. But, of course, Java does not have array slices.

      To get around this, we either need to switch to ByteBuffers (which support slices) or break apart the serialized Change into just serialized old and new values.

      Attachments

        Activity

          People

            vvcephei John Roesler
            vvcephei John Roesler
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: