Details
-
Improvement
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
None
-
None
Description
It takes hours for datanode to finish the volume and container initailization. Worst case is after 12hours it is still running volume reader on one datanode, which has 11 datanode volumes and each volume has 8000+ containers.
Before the patch applied, most of the volume reader threads are waiting for the ContainerCache lock. With the patch applied, the worst case datanode cost 17m to finish the volume and container verify process.
BTW: why there are so many containers are still under investigation. It might the result of pipeline close. So in long term, I think we should consider reuse healthy but not full containers which are closed because of their pipelines are closed.
Attachments
Attachments
Issue Links
- is related to
-
HDDS-3217 Datanode startup is slow due to iterating container DB 2-3 times
- Resolved
- links to