Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-11445

HBase support Phase II

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.0.0 (obsolete, don't use)
    • None
    • None
    • None

    Description

      In continuation of HDDS-7593. With HDDS-7593 and to be released in the upcoming Ozone 2.0, HBase can run on Ozone with good performance.

      This jira tracks follow-up bug fixes and improvements.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDDS-11521 Race condition between pipeline close and block allocation causes client aborts

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDDS-11449 Ambigious "Ignoring ozone.fs.hsync.enabled because HBase enhancements are disallowed" logs

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDDS-11558 Make OM client retry idempotent

          • Major - Major loss of function.
          • Resolved
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDDS-7593 Supporting HSync and lease recovery

          • Major - Major loss of function.
          • Resolved
          1.
          		 Support incremental ChunkBuffer checksum calculation Sub-task Open Siyao Meng
          2.
          		 [hsync] Improve test coverage for XceiverClientRatis.java Sub-task Resolved Chung En Lee
          3.
          		 Freon DN Echo should skip writing payload to ratis log Sub-task In Progress Wei-Chiu Chuang
          4.
          		 Add metrics for OzoneChecksumException Sub-task Open Unassigned
          5.
          		 Explore client retry optimizations after write() and hsync() are desynced Sub-task Open Unassigned
          6.
          		 Add test case to cover HDDS-9930 batch key deletion Sub-task Open Unassigned
          7.
          		 [hsync] Update OpenTelemetry traces in the write path Sub-task In Progress Wei-Chiu Chuang
          8.
          		 [hsync] Improve test coverage for LeaseRecoveryClientDNHandler Sub-task Open Unassigned
          9.
          		 [hsync] Compatibility test Sub-task Resolved Hemant Kumar
          10.
          		 Hsync client-side metrics Sub-task Resolved Duong
          11.
          		 [Discuss] Colocate Ozone client and pipeline leader to reduce latency Sub-task Open Unassigned
          12.
          		 [hsync] Optimize FilePerBlockStrategy.writeChunk() Sub-task Open Siyao Meng
          13.
          		 Manage Netty native memory consumption Sub-task Open Unassigned
          14.
          		 Any open key rename should ideally be blocked Sub-task Open Unassigned
          15.
          		 [hsync] Adopt RATIS-1994 to reduce hsync latency Sub-task Patch Available Siyao Meng
          16.
          		 [hsync] Freon DN Echo to support --wait-for-commit parameter Sub-task Open Wei-Chiu Chuang
          17.
          		 Make key visible immediately upon create() Sub-task Open Unassigned
          18.
          		 Add hsync and lease recovery Documentation Sub-task In Progress Wei-Chiu Chuang
          19.
          		 Increase DataNode XceiverServerGrpc event loop group size Sub-task Open Unassigned
          20.
          		 [hsync] Improve WriteChunk to send incremental data only Sub-task Resolved Siyao Meng
          21.
          		 Minor optimizations on the write path Sub-task Resolved Duong
          22.
          		 New tool to micro benchmark hbase performance in Ozone Sub-task Open Duong

          Activity

            People

              Unassigned Unassigned
              weichiu Wei-Chiu Chuang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: