Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14629 Performance improvement for Zstd compressed workload
  3. KAFKA-14634

Compression optimization: Calculate the size of decompressed buffer dynamically at runtime.

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Calculate the size of decompressed buffer dynamically at runtime. It could be based on recommendation provided by Zstd. Currently fixed at 16KB. Using the value that is recommended by Zstd saves a copy in native code.
      see: https://github.com/facebook/zstd/issues/340

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            divijvaidya Divij Vaidya
            divijvaidya Divij Vaidya

            Dates

              Created:
              Updated:

              Slack

                Issue deployment