Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7024

Rocksdb state directory should be created before opening the DB

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: streams
    • Labels:

      Description

      After enabling rocksDB logging, We continually see these errors in kafka stream logs, everytime a new window segment is created
      ```
      Error when reading <rocksdb-directory-path>
      ```
      While its not a problem in itself, since rocksDB internally will create the directory but It will do so only after logging the above error. It would avoid unnecessary logging if the segment directory can be created in advance. Right now, only the parent directories are created for a rocksDB segment. Logging is more prominent when there are many partitions and segment size is smaller (minute or two).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Yohan123 Richard Yu
                Reporter:
                abhishek.agarwal Abhishek Agarwal
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: