Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
3.3.0
-
None
Description
`hdfs dfsadmin -listOpenFiles -path /any/path` will request all opened files. In the NameNode side, the function LeaseManager.java#getUnderConstructionFiles will be called.
When there are only N(<maxListOpenFilesResponses, default is 100) files meet the conditions, but the leaseManager contains M(>maxListOpenFilesResponses) files, we will scan all leases. Finally, the hasMore will be set true and the openFileEntries contains N files, the scenario will cause listOpenFiles() be called again.
If M is greater more than N, the two calls to getUnderConstructionFiles will impact the NameNode performance.
Attachments
Attachments
Issue Links
- relates to
-
HDFS-10480 Add an admin command to list currently open files
-
- Resolved
-