Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-12978

Fine-grained locking while consuming journal stream.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.2.0, 3.1.1, 3.0.4
    • namenode
    • None
    • Reviewed

    Description

      In current implementation SBN consumes the entire segment of transactions under a single namesystem lock, which does not allow reads over a long period of time until the segment is processed. We should break the lock into fine grained chunks. In extreme case each transaction should release the lock once it is applied.

      Attachments

        1. HDFS-12978.001.patch
          11 kB
          Konstantin Shvachko
        2. HDFS-12978.002.patch
          11 kB
          Konstantin Shvachko
        3. HDFS-12978.003.patch
          10 kB
          Konstantin Shvachko

        Activity

          People

            shv Konstantin Shvachko
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: