Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-9904

Ozone reads as data streams

    XMLWordPrintableJSON

Details

    Description

      Today, Ozone data read is done in a discrete fashion via GRPC where each chunk is modeled as a ReadChunk response. Because of that, we have to implement a big chunk size to archive stream-like performance, and other unnatural improvements like ZeroCopy on GRPC.
      GRPC and discrete data transfer protocol is not the perfect fit for data transfer. We should move to use native stream, leverage Netty, to implement data read. 

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDDS-10338 Implement a Client Datanode API to stream a block

          • Major - Major loss of function.
          • In Progress
          relates to

          New Feature - A new feature of the product, which has yet to be developed. RATIS-1086 Streaming: support read requests

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-9903 EC data write as data streams

          • Major - Major loss of function.
          • Open

          Activity

            People

              szetszwo Tsz-wo Sze
              duongnguyen Duong
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: