Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-1373

LogCleaner assumes first dirty offset zero if there is no cleaner checkpoint

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.1
    • 0.8.1.1
    • None
    • None

    Description

      If you try enabling the compaction policy on a topic that already exists and if its first segment starts with anything other than zero you will see something like this:

      java.lang.IllegalArgumentException: requirement failed: Last clean offset is 0 but segment base offset is 2722629 for log test-0.
      at scala.Predef$.require(Predef.scala:145)
      at kafka.log.Cleaner.buildOffsetMap(LogCleaner.scala:489)
      at kafka.log.Cleaner.clean(LogCleaner.scala:287)
      at kafka.log.LogCleaner$CleanerThread.cleanOrSleep(LogCleaner.scala:203)
      at kafka.log.LogCleaner$CleanerThread.doWork(LogCleaner.scala:188)
      at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:51)

      Attachments

        1. KAFKA-1373_2014-04-08_16:18:22.patch
          5 kB
          Joel Jacob Koshy
        2. KAFKA-1373.patch
          4 kB
          Joel Jacob Koshy
        3. KAFKA-1373.patch
          3 kB
          Joel Jacob Koshy

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jjkoshy Joel Jacob Koshy
            jjkoshy Joel Jacob Koshy
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment