Description
Currently, the default is 8MB which is very small. The servers will roll the log frequently and create a lot of small files.
According to William Song's comment, 32MB seems a good choice.
It's only that I did experiments earlier and found 32MB is the optimal for IOTDB default workload. The experiments show:
- (end to end throughput) improves substantially as segmented size grow from 8MB to 32MB, slowly from 32MB to 128MB.
- The memory usage in JVM young increases as the segmented size grow, even if we restricted the max-cached-size and max-cached-segments. It turned out to be the open segment.
Attachments
Issue Links
- is related to
-
HDDS-8040 Increase ratis log segment default size and default preallocated size in datanode
-
- Resolved
-
- links to
