Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7334

Suggest changing config for state.dir in case of FileNotFoundException

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: streams
    • Labels:

      Description

      Quoting stack trace from KAFKA-5998 :

      WARN [2018-08-22 03:17:03,745] org.apache.kafka.streams.processor.internals.ProcessorStateManager: task [0_45] Failed to write offset checkpoint file to /tmp/kafka-streams/<application_id>
      {{ /0_45/.checkpoint: {}}}
      {{ ! java.nio.file.NoSuchFileException: /tmp/kafka-streams/<application_id>/0_45/.checkpoint.tmp}}
      {{ ! at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)}}
      {{ ! at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)}}
      

      When state.dir is left at default configuration, there is a chance that certain files under the state directory are cleaned by OS since the default dir starts with /tmp/kafka-streams.

      Matthias J. Sax and I proposed to suggest user, through exception message, to change the location for state.dir .

        Attachments

          Activity

            People

            • Assignee:
              vladimir_shadrin Vladimir
              Reporter:
              yuzhihong@gmail.com Ted Yu
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: