Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1755

Improve error handling in log cleaner

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0.0
    • None

    Description

      The log cleaner is a critical process when using compacted topics.
      However, if there is any error in any topic (notably if a key is missing) then the cleaner exits and all other compacted topics will also be adversely affected - i.e., compaction stops across the board.

      This can be improved by just aborting compaction for a topic on any error and keep the thread from exiting.

      Another improvement would be to reject messages without keys that are sent to compacted topics although this is not enough by itself.

      Attachments

        1. KAFKA-1755_2015-02-23_14:29:54.patch
          39 kB
          Joel Jacob Koshy
        2. KAFKA-1755_2015-02-26_10:54:50.patch
          43 kB
          Joel Jacob Koshy
        3. KAFKA-1755.patch
          36 kB
          Joel Jacob Koshy

        Issue Links

          Activity

            People

              jjkoshy Joel Jacob Koshy
              jjkoshy Joel Jacob Koshy
              Jay Kreps Jay Kreps
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: