[KAFKA-6186] RocksDB based WindowStore fail to create db file on Windows OS

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.0.0
• Component/s: streams
• Environment: Windows OS
• Assignee: Unassigned
• Reporter: Jianshao Wu
• Created: 08/Nov/17 11:10
• Updated: 08/Nov/17 12:13
• Resolved: 08/Nov/17 12:13

Description

Code snippet just like below

...
textLines.flatMapValues(value -> Arrays.asList(pattern.split(value.toLowerCase()))).groupBy((key, word) -> word)
.windowedBy(TimeWindows.of(10000)).count(Materialized.as("Counts"));
...

Run it on Windows, then the exception is throw as below

Caused by: org.rocksdb.RocksDBException: Failed to create dir: F:\tmp\kafka-streams\wordcount-lambda-example\1_0\Counts\Counts:1510099200000: Invalid argument
at org.rocksdb.RocksDB.open(Native Method) ~[rocksdbjni-5.7.3.jar:na]
at org.rocksdb.RocksDB.open(RocksDB.java:231) ~[rocksdbjni-5.7.3.jar:na]
at org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:197) ~[kafka-streams-1.0.0.jar:na]
... 29 common frames omitted

Checked the code, I found the issue is caused by line 72 in org.apache.kafka.streams.state.internals.Segments

String segmentName(final long segmentId)

{ // previous format used - as a separator so if this changes in the future // then we should use something different. return name + ":" + segmentId * segmentInterval; }

"segmentName" is passed to RocksDB, RockDB will use it as file name to create the DB file, as we known, the ":" cannot be part of file name in Windows OS.

Issue Links

• duplicates: KAFKA-6167 Timestamp on streams directory contains a colon, which is an illegal character