Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.3.6
-
None
Description
- In the case of configuring 3 journal nodes in HDFS, if only 2 journal nodes are available and 1 journal node fails to start due to machine issues, it will result in a long initialization time for the namenode (around 30-40 minutes, depending on the IPC timeout and retry policy configuration).
- The failed journal node cannot recover immediately, but HDFS can still function in this situation. In our production environment, we encountered this issue and had to reduce the IPC timeout and adjust the retry policy to accelerate the namenode initialization and provide services.
- I'm wondering if it would be possible to have a journal node maintenance list to speed up the namenode initialization knowing that one journal node cannot provide services in advance?
Attachments
Issue Links
- duplicates
-
HADOOP-18937 Add journalnode maintenance node list
- Resolved
- links to