[HDFS-14703] NameNode Fine-Grained Locking via Metadata Partitioning

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: hdfs, namenode
• Assignee: Unassigned
• Reporter: Konstantin Shvachko
• Created: 06/Aug/19 01:36
• Updated: 08/Sep/20 00:43

Description

We target to enable fine-grained locking by splitting the in-memory namespace into multiple partitions each having a separate lock. Intended to improve performance of NameNode write operations.

Sub-Tasks

• [FGL] Remove redundant locking on NameNode.: Resolved
• [FGL] Introduce PartitionedGSet a new implementation of GSet.: Open
• [FGL] Introduce INode key.: Open
• [FGL] Introduce Latch Lock to replace Namesystem global lock.: Open