Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-13150

[Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC

    XMLWordPrintableJSON

    Details

      Description

      In the interest of making coordinated/consistent reads easier to complete with low latency, it is advantageous to reduce the time between when a transaction is applied on the ANN and when it is applied on the SbNN. We propose adding a new "fast path" which can be used to tail edits when low latency is desired. We leave the existing tailing logic in place, and fall back to this path on startup, recovery, and when the fast path encounters unrecoverable errors.

        Attachments

        1. edit-tailing-fast-path-design-v2.pdf
          172 kB
          Erik Krogen
        2. edit-tailing-fast-path-design-v1.pdf
          171 kB
          Erik Krogen
        3. edit-tailing-fast-path-design-v0.pdf
          165 kB
          Erik Krogen

          Issue Links

            Activity

              People

              • Assignee:
                xkrogen Erik Krogen
                Reporter:
                xkrogen Erik Krogen
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: