[KAFKA-1819] Cleaner gets confused about deleted and re-created topics

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.8.2.0
• Assignee: Gwen Shapira
• Reporter: Gian Merlino
• Created: 15/Dec/14 02:24
• Updated: 13/Jan/15 05:33
• Resolved: 13/Jan/15 05:33

Description

I get an error like this after deleting a compacted topic and re-creating it. I think it's because the brokers don't remove cleaning checkpoints from the cleaner-offset-checkpoint file. This is from a build based off commit bd212b7.

java.lang.IllegalArgumentException: requirement failed: Last clean offset is 587607 but segment base offset is 0 for log foo-6.
at scala.Predef$.require(Predef.scala:233)
at kafka.log.Cleaner.buildOffsetMap(LogCleaner.scala:502)
at kafka.log.Cleaner.clean(LogCleaner.scala:300)
at kafka.log.LogCleaner$CleanerThread.cleanOrSleep(LogCleaner.scala:214)
at kafka.log.LogCleaner$CleanerThread.doWork(LogCleaner.scala:192)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:60)