Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14703

NameNode Fine-Grained Locking via Metadata Partitioning

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs, namenode
    • None

    Description

      We target to enable fine-grained locking by splitting the in-memory namespace into multiple partitions each having a separate lock. Intended to improve performance of NameNode write operations.

      Attachments

        1. NameNode Fine-Grained Locking.pdf
          128 kB
          Konstantin Shvachko
        2. 001-partitioned-inodeMap-POC.tar.gz
          15 kB
          Konstantin Shvachko
        3. NameNode Fine-Grained Locking.pdf
          173 kB
          Konstantin Shvachko
        4. 002-partitioned-inodeMap-POC.tar.gz
          7 kB
          Konstantin Shvachko
        5. 003-partitioned-inodeMap-POC.tar.gz
          12 kB
          Konstantin Shvachko

        Activity

          People

            Unassigned Unassigned
            shv Konstantin Shvachko
            Votes:
            3 Vote for this issue
            Watchers:
            64 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 13h 20m
                13h 20m