Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Control the number of files of all compaction threads in the system to prevent too many open file handles.
Now we have control the number of files in a single compaction task, but not strictly. For example, in cross-space compaction, if an unseq file has a large time span and overlaps with too many seq files, it is allowed to execute the task and may increase a huge number of open file handles. The improvement method is to control the total number of source files of the compaction threads in the system, check the number of files before the task starts, wait if it exceeds the threshold, and exit after timeout.
