Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-14858

[SBN read] Allow configurably enable/disable AlignmentContext on NameNode

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.3.0, 3.1.4, 3.2.2
    • hdfs
    • None

    Description

      As brought up under HDFS-14277, we should make sure SBN read has no performance impact when it is not enabled. One potential overhead of SBN read is maintaining and updating additional state status on NameNode. Specifically, this is done by creating/updating/checking a GlobalStateIdContext instance. Currently, even without enabling SBN read, this logic is still be checked. We can make this configurable so that when SBN read is not enabled, there is no such overhead and everything works as-is.

      Attachments

        1. HDFS-14858.001.patch
          7 kB
          Chen Liang
        2. HDFS-14858.002.patch
          8 kB
          Chen Liang
        3. HDFS-14858.003.patch
          9 kB
          Chen Liang
        4. HDFS-14858.004.patch
          10 kB
          Chen Liang

        Issue Links

          is related to

          Task - A task that needs to be done. HDFS-14277 [SBN read] Observer benchmark results

          • Major - Major loss of function.
          • Open

          Activity

            People

              vagarychen Chen Liang
              vagarychen Chen Liang
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: