Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7574

Kafka unable to delete segment file in Linux

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.0.0
    • Fix Version/s: None
    • Component/s: core, log
    • Labels:
      None
    • Environment:
      Debian Stretch

      Description

      The initial error is that Kafka believes it is unable to delete a log segment file. This causes Kafka to mark the log directory as unavailable and eventually shut down without flushing data to disk (which is probably the right thing to do). There are no indications in the OS logs of a failed filesystem or any other OS level issue. We have verified that filesystem is consistent.

      Is there a IO timeout of some kind that can be adjusted or is something else happening? Potential duplicate of race condition seen inĀ KAFKA-6194.

      See attached files for config and example log pattern.

        Attachments

        1. kafka-delete_error_pattern.log
          5 kB
          Ben Maas
        2. kafka-config.log
          7 kB
          Ben Maas

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bmaas Ben Maas
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: