Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1755

Improve error handling in log cleaner

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0.0
    • Component/s: None
    • Labels:

      Description

      The log cleaner is a critical process when using compacted topics.
      However, if there is any error in any topic (notably if a key is missing) then the cleaner exits and all other compacted topics will also be adversely affected - i.e., compaction stops across the board.

      This can be improved by just aborting compaction for a topic on any error and keep the thread from exiting.

      Another improvement would be to reject messages without keys that are sent to compacted topics although this is not enough by itself.

        Attachments

        1. KAFKA-1755.patch
          36 kB
          Joel Koshy
        2. KAFKA-1755_2015-02-23_14:29:54.patch
          39 kB
          Joel Koshy
        3. KAFKA-1755_2015-02-26_10:54:50.patch
          43 kB
          Joel Koshy

          Issue Links

            Activity

              People

              • Assignee:
                jjkoshy Joel Koshy
                Reporter:
                jjkoshy Joel Koshy
                Reviewer:
                Jay Kreps
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: