Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7593 Supporting HSync and lease recovery
  3. HDDS-9842

[hsync] Checking disk capacity at every write request is expensive for HBase

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None

    Description

      Inside HddsDispatcher.dispatchRequest has a disk usage check, which is relatively expensive for HBase WAL when there are hundreds and thousands of write chunks per second.

      This is even after implementing incremental chunk list in HDDS-8047.

      Attachments

        Issue Links

        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HDDS-9380 Reduce the number of system calls when DN writes a key

        • Major - Major loss of function.
        • Resolved
        links to

        Web Link GitHub Pull Request #6381

        Web Link GitHub Pull Request #6383

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            adoroszlai Attila Doroszlai Assign to me
            weichiu Wei-Chiu Chuang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment