Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-13150

[Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC

    XMLWordPrintableJSON

Details

    Description

      In the interest of making coordinated/consistent reads easier to complete with low latency, it is advantageous to reduce the time between when a transaction is applied on the ANN and when it is applied on the SbNN. We propose adding a new "fast path" which can be used to tail edits when low latency is desired. We leave the existing tailing logic in place, and fall back to this path on startup, recovery, and when the fast path encounters unrecoverable errors.

      Attachments

        1. edit-tailing-fast-path-design-v0.pdf
          165 kB
          Erik Krogen
        2. edit-tailing-fast-path-design-v1.pdf
          171 kB
          Erik Krogen
        3. edit-tailing-fast-path-design-v2.pdf
          172 kB
          Erik Krogen

        Issue Links

          Activity

            People

              xkrogen Erik Krogen
              xkrogen Erik Krogen
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: