Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7593 Supporting HSync and lease recovery
  3. HDDS-9844

[hsync] De-synchronize hsync API

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • HDDS-7593
    • None

    Description

      The current hysnc implementation KeyOutputStream.hsync() is wrapped in a synchronized block. The HBase write ahead log FSHLog.SyncRunner has multiple threads invoking hsync in parallel to reduce client latency.

      We should unsynchronize Ozone's hsync such that it doesn't block waiting for the Ratis transaction to respond.

      cc: szetszwo this is what we discussed offline.

      Attachments

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HDDS-11193 KeyOutputStream flakiness when running write and hsync concurrently

          • Major - Major loss of function.
          • Resolved
          incorporates

          Sub-task - The sub-task of the issue HDDS-11073 [hsync] Improve BlockOutputStream's BufferPool to support variable buffer allocation from concurrent hsync

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is a parent of

          Sub-task - The sub-task of the issue HDDS-11184 [hsync] Add a client config to limit write concurrency on the same key

          • Major - Major loss of function.
          • Resolved
          is required by

          Sub-task - The sub-task of the issue HDDS-11043 Explore client retry optimizations after write() and hsync() are desynced

          • Major - Major loss of function.
          • Open
          relates to

          Sub-task - The sub-task of the issue HDDS-11073 [hsync] Improve BlockOutputStream's BufferPool to support variable buffer allocation from concurrent hsync

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Sub-task - The sub-task of the issue HDDS-11174 [hsync] Change XceiverClientRatis.watchForCommit to async

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #6207

          Web Link GitHub Pull Request #6413

          Web Link GitHub Pull Request #6777

          Web Link GitHub Pull Request #6859

          Activity

            People

              duongnguyen Duong
              weichiu Wei-Chiu Chuang
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: