[HDFS-15185] StartupProgress reports edits segments until the entire startup completes

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.10.0
• Fix Version/s: 3.3.0, 3.1.4, 3.2.2, 2.10.1
• Component/s: namenode
• Target Version/s: 2.10.1
• Hadoop Flags: Reviewed
• Assignee: Konstantin Shvachko
• Reporter: Konstantin Shvachko
• Created: 20/Feb/20 01:52
• Updated: 21/Feb/20 19:23
• Resolved: 21/Feb/20 19:10

Description

Startup Progress page keeps reporting edits segments after the LOAD_EDITS stage is complete. New steps are added to StartupProgress while journal tailing until all startup phases are completed. This adds a lot of edits steps, since SAFEMODE phase can take a long time on a large cluster.
With fast tailing the segments are small, but the number of them is large - 160K. This makes the page load forever.

Issue Links

• is related to: HDFS-14500 NameNode StartupProgress continues to report edit log segments after the LOADING_EDITS phase is finished