Description
The log cleaner is a critical process when using compacted topics.
However, if there is any error in any topic (notably if a key is missing) then the cleaner exits and all other compacted topics will also be adversely affected - i.e., compaction stops across the board.
This can be improved by just aborting compaction for a topic on any error and keep the thread from exiting.
Another improvement would be to reject messages without keys that are sent to compacted topics although this is not enough by itself.
Attachments
Attachments
Issue Links
- relates to
-
KAFKA-1581 Log cleaner should have an option to ignore messages without keys
-
- Resolved
-