Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14629 Performance improvement for Zstd compressed workload
  3. KAFKA-14632

Compression optimization: Remove unnecessary intermediate buffers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.6.0
    • None
    • None

    Description

      Remove two layers of buffers (the 16KB one and 2KB one) and replace with a single buffer called decompressionBuffer. The time it takes to prepare a batch for decompression will be bounded by the allocation of largest buffer and hence, using only one large buffer (16KB) doesn’t cause any regression.

      Attachments

        Activity

          People

            divijvaidya Divij Vaidya
            divijvaidya Divij Vaidya
            Ismael Juma Ismael Juma
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: