Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-561

Rebuild index file for a log segment if there is none

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.1
    • Component/s: None
    • Labels:
      None

      Description

      There are two ways an index file could be missing:
      1. Someone could delete it or it could be lost due to file corruption
      2. The server could crash in the middle of rolling the log after having created the new log segment but before having created the corresponding index segment.

      Regardless it would be nice to recover gracefully from this and rebuild the index segment off the corresponding log segment if this happened. This will be slow.

      This should be done after KAFKA-521.

        Attachments

          Activity

            People

            • Assignee:
              jkreps Jay Kreps
              Reporter:
              jkreps Jay Kreps
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: