Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7593 Supporting HSync and lease recovery
  3. HDDS-9842

[hsync] Checking disk capacity at every write request is expensive for HBase

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • None

    Description

      Inside HddsDispatcher.dispatchRequest has a disk usage check, which is relatively expensive for HBase WAL when there are hundreds and thousands of write chunks per second.

      This is even after implementing incremental chunk list in HDDS-8047.

      Attachments

        1. Screen Shot 2023-12-05 at 11.03.12 AM.png
          613 kB
          Wei-Chiu Chuang
        2. ozone_dn-weichiu-1.weichiu.root.hwx.site.html
          440 kB
          Wei-Chiu Chuang

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-9380 Reduce the number of system calls when DN writes a key

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6381

          Web Link GitHub Pull Request #6383

          Activity

            People

              adoroszlai Attila Doroszlai
              weichiu Wei-Chiu Chuang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: