Kafka
  1. Kafka
  2. KAFKA-561

Rebuild index file for a log segment if there is none

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.1
    • Component/s: None
    • Labels:
      None

      Description

      There are two ways an index file could be missing:
      1. Someone could delete it or it could be lost due to file corruption
      2. The server could crash in the middle of rolling the log after having created the new log segment but before having created the corresponding index segment.

      Regardless it would be nice to recover gracefully from this and rebuild the index segment off the corresponding log segment if this happened. This will be slow.

      This should be done after KAFKA-521.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        57d 7h 27m 1 Jay Kreps 06/Dec/12 05:13
        Jay Kreps made changes -
        Issue Type New Feature [ 2 ] Improvement [ 4 ]
        Jay Kreps made changes -
        Field Original Value New Value
        Status Open [ 1 ] Resolved [ 5 ]
        Assignee Jay Kreps [ jkreps ]
        Fix Version/s 0.8.1 [ 12322960 ]
        Resolution Fixed [ 1 ]
        Hide
        Jay Kreps added a comment -

        This was fixed as part of the log refactoring.

        Show
        Jay Kreps added a comment - This was fixed as part of the log refactoring.
        Jay Kreps created issue -

          People

          • Assignee:
            Jay Kreps
            Reporter:
            Jay Kreps
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development