Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-398

Enable compression in Kafka checkpoint and changelog topics

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: kafka
    • Labels:
      None

      Description

      Once KAFKA-1374 is committed, we should allow checkpoint and changelog messages in Kafka to be compressed. Right now, we explicitly force uncompressed messages in KafkaCheckpointManagerFactory and KafkaSystemFactory to prevent the log compaction from breaking.

        Attachments

          Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. SAMZA-586 LoggedStore can send compressed messages to log-compacted Kafka topic

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-1374 LogCleaner (compaction) does not support compressed topics

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                criccomini Chris Riccomini
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated: