[HDFS-10616] Improve performance of path handling

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0-alpha
• Component/s: hdfs
• Target Version/s: 3.5.0
• Assignee: Daryn Sharp
• Reporter: Daryn Sharp
• Created: 12/Jul/16 18:08
• Updated: 04/Jan/24 07:49

Description

Path handling in the namesystem and directory is very inefficient. The path is repeatedly resolved, decomposed into path components, recombined to a full path. parsed again, throughout the system. This is directly inefficient for general performance, and indirectly via unnecessary pressure on young gen GC.

The namesystem should only operate on paths, parse it once into inodes, and the directory should only operate on inodes.

Sub-Tasks

• Cache symlinkString in INodeSymlink: Patch Available