Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4099

Change the time based log rolling to only based on the message timestamp.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.1.0
    • Component/s: core
    • Labels:
      None

      Description

      This is an issue introduced in KAFKA-3163. When partition relocation occurs, the newly created replica may have messages with old timestamp and cause the log segment rolling for each message. The fix is to change the log rolling behavior to only based on the message timestamp when the messages are in message format 0.10.0 or above. If the first message in the segment does not have a timetamp, we will fall back to use the wall clock time for log rolling.

        Attachments

          Activity

            People

            • Assignee:
              becket_qin Jiangjie Qin
              Reporter:
              becket_qin Jiangjie Qin

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment