Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12943 Consistent Reads from Standby Node
  3. HDFS-14858

[SBN read] Allow configurably enable/disable AlignmentContext on NameNode

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.3.0, 3.1.4, 3.2.2
    • hdfs
    • None

    Description

      As brought up under HDFS-14277, we should make sure SBN read has no performance impact when it is not enabled. One potential overhead of SBN read is maintaining and updating additional state status on NameNode. Specifically, this is done by creating/updating/checking a GlobalStateIdContext instance. Currently, even without enabling SBN read, this logic is still be checked. We can make this configurable so that when SBN read is not enabled, there is no such overhead and everything works as-is.

      Attachments

        1. HDFS-14858.004.patch
          10 kB
          Chen Liang
        2. HDFS-14858.003.patch
          9 kB
          Chen Liang
        3. HDFS-14858.002.patch
          8 kB
          Chen Liang
        4. HDFS-14858.001.patch
          7 kB
          Chen Liang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vagarychen Chen Liang
            vagarychen Chen Liang
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment