Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7334

Suggest changing config for state.dir in case of FileNotFoundException

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • streams

    Description

      Quoting stack trace from KAFKA-5998 :

      WARN [2018-08-22 03:17:03,745] org.apache.kafka.streams.processor.internals.ProcessorStateManager: task [0_45] Failed to write offset checkpoint file to /tmp/kafka-streams/<application_id>
      {{ /0_45/.checkpoint: {}}}
      {{ ! java.nio.file.NoSuchFileException: /tmp/kafka-streams/<application_id>/0_45/.checkpoint.tmp}}
      {{ ! at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
      {{ ! at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
      

      When state.dir is left at default configuration, there is a chance that certain files under the state directory are cleaned by OS since the default dir starts with /tmp/kafka-streams.

      mjsax and I proposed to suggest user, through exception message, to change the location for state.dir .

      Attachments

        Activity

          People

            vladimir_shadrin Vladimir
            yuzhihong@gmail.com Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: