Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-315

enable shallow iterator in ByteBufferMessageSet to allow mirroing data without decompression

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.7.1
    • core
    • None

    Description

      Currently, the iterator of ByteBufferMessageSet does deep iteration, ie, if messages are compressed, they will be decompressed first during the iteration. This adds CPU overhead. For mirroring data between 2 Kafka clusters, we can use a shallow iterator to avoid the decompression overhead.

      Attachments

        1. kafka-315.patch
          9 kB
          Jun Rao

        Activity

          People

            junrao Jun Rao
            junrao Jun Rao
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: