[HDFS-17354] Delay invoke clearStaleNamespacesInRouterStateIdContext during router start up

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.1, 3.5.0
• Labels: pull-request-available
• Assignee: lei w
• Reporter: lei w
• Created: 24/Jan/24 08:44
• Updated: 26/Mar/24 00:59
• Resolved: 21/Mar/24 08:38

Description

We should start clear expired namespace thread at RouterRpcServer RUNNING phase because StateStoreService is Initialized in initialization phase. Now, router will throw IoException when start up.

Exception

2024-01-09 16:27:06,939 WARN org.apache.hadoop.hdfs.server.federation.router.RouterRpcServer: Could not fetch current list of namespaces.
java.io.IOException: State Store does not have an interface for MembershipStore
at org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver.getStoreInterface(MembershipNamenodeResolver.java:121)
at org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver.getMembershipStore(MembershipNamenodeResolver.java:102)
at org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver.getNamespaces(MembershipNamenodeResolver.java:388)
at org.apache.hadoop.hdfs.server.federation.router.RouterRpcServer.clearStaleNamespacesInRouterStateIdContext(RouterRpcServer.java:434)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

Issue Links

• causes: HDFS-17435 Fix TestRouterRpc failed
• links to: GitHub Pull Request #6498