Uploaded image for project: 'Ratis'
  1. Ratis
  2. RATIS-979

Ratis streaming

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Streaming
    • None

    Description

      In this JIRA, we design and implement Ratis Streaming with zero buffer copying and asynchronous event driven.

      Attachments

        1. screenshot-3.png
          63 kB
          runzhiwang
        2. screenshot-2.png
          15 kB
          runzhiwang
        3. screenshot-1.png
          16 kB
          runzhiwang
        4. RatisStreaming20200929.pdf
          54 kB
          Tsz-wo Sze
        5. image-2021-05-26-21-07-39-843.png
          58 kB
          mingchao zhao

        Issue Links

          1.
          Benchmarking Flatbuffers and Protobuffers for GRPC streaming Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          2.
          A simple benchmark achieving zero-copy semantics using Netty. Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          3.
          Define internal streaming APIs Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 50m
          4.
          Implement ratis streaming using netty Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          5.
          Implement ratis streaming using netty - Client code Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          6.
          Implement ratis streaming using netty - Server code Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          7.
          Update netty version - 4.1.50.Final Sub-task Resolved Ansh Khanna  
          8.
          Update ratis-thirdparty version in order to use the latest netty Sub-task Resolved Ansh Khanna

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 10m
          9.
          Refactor DataStream classes Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 50m
          10.
          Improve encoder/decoder by javadoc and error catch Sub-task Resolved Unassigned  
          11.
          Change NettyServerStreamRpc to write data to StateMachine Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          12.
          Netty stream server should forward the data to the other servers in the group Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 18h 20m
          13.
          Create a transaction once the stream data is replicated to all servers Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 20m
          14.
          Support multiple groups in Streaming Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          15.
          Encode a RaftClientRequest as the head of a stream request Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m
          16.
          Add getDataStreamApi() to RaftClient Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 20m
          17.
          Implement RaftClient.getDataStreamApi() Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          18.
          DataStreamOutputImpl should use streamOffset instead of messageId Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3.5h
          19.
          DataStreamReply should include byteWritten and isSuccess Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          20.
          DataStreamServerRpc should connect other peers automatically Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          21.
          Should check "bytewritten" from remote writes to peers to determine whether current stream write is successful Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h
          22.
          Refactor Netty streaming encoder and decoder Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5.5h
          23.
          Add type for DataStream Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          24.
          Start NettyServerStreamRpc when create RaftServerProxy Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          25.
          Add SupportedDataStreamType.DISABLED Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 6.5h
          26.
          Fix DataStreamReply out of order Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          27.
          Change the FileStore example to use Streaming Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 9h 10m
          28.
          Change NettyServerStreamRpc to use only one ConcurrentMap Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          29.
          NettyServerStreamRpc should handle duplicate headers Sub-task Resolved Rui Wang  
          30.
          Add DataStreamType Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          31.
          Remove DataStreamClient.start() and DataStreamClientRpc.startClient() Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          32.
          Remove DataStreamServerRpc.start() Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          33.
          Support multiple streams Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          34.
          Support multiple DataStream clients Sub-task Resolved Tsz-wo Sze  
          35.
          Use thenApplyAsync instead of thenApply Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          36.
          NettyServerStreamRpc should get stateMachine from RaftServer Sub-task Resolved Tsz-wo Sze  
          37.
          Fix TestDataStream Sub-task Resolved Rui Wang  
          38.
          Fix can not support more than 10 stream Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          39.
          Add a stream(RaftGroupId) method to DataStreamApi. Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          40.
          Move out the RPC related APIs from DataStreamOutput Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          41.
          Have a E2E test for Ratis streaming based on MiniRaftCluster Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 7h 40m
          42.
          Primary and peer should use the same streamId Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          43.
          Primary and peer should use the same RaftClientRequest Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          44.
          Remove DataStreamApi.stream(RaftGroupId). Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          45.
          Initialize DataStreamServer after RaftServerProxy id is set Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          46.
          Add DataStreamRequestTypeProto Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          47.
          Rename StreamRequestTypeProto to MessageStreamRequestTypeProto Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          48.
          Add dataStreamAddress to RaftPeer Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4.5h
          49.
          Do not create DataStreamOutput for non-primary server Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3.5h
          50.
          Remove STREAM_CLOSE_FORWARD Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          51.
          Return exception of submitClientRequestAsync to client. Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          52.
          Default disable datastream when start a MiniRaftCluster Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          53.
          In NettyServerStreamRpc, the local/remote writes should only wait for the previous write Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          54.
          In NettyServerStreamRpc, each remote stream should not wait for its own previous write. Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          55.
          Return DataStreamException to client. Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 10m
          56.
          Move the DateStream requests handling code from NettyServerStreamRpc to a new class Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          57.
          Implement ChannelInboundHandler.exceptionCaught in NettyServerStreamRpc Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 6h 20m
          58.
          Add sync flag when write stream data Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          59.
          Add a builder for DataStreamReplyByteBuffer Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h
          60.
          DataStreamClientImpl.closeAsync() should be idempotent Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          61.
          Enable testing clusters with Netty data stream and gRPC Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h
          62.
          Link DataStream with LogEntryProto Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          63.
          Move the utils from DataStreamBaseTest to a new file Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          64.
          Move the DataStream tests from TestDataStreamNetty to DataStreamClusterTests Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          65.
          Support WriteSmallFile by ratis streaming Sub-task Resolved runzhiwang  
          66.
          Allow null for the stream parameter in StateMachine.DataApi.link Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h
          67.
          DataStreamApi/DataStreamOutput should expose stream close() Sub-task Resolved Rui Wang  
          68.
          Rename StateMachineDataChannel to DataChannel Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          69.
          Test leader change when close stream Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 10m
          70.
          DataStreamOutput should support FileChannel#transferTo Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h 40m
          71.
          Use RaftClient to submit request Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m
          72.
          Add a new API to DataStreamOutput for sending a File Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          73.
          Change the FileStore CLI to use Streaming. Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          74.
          Enhance FileStore steaming tests Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          75.
          Executor thread crashes on NPE Sub-task Resolved Rui Wang  
          76.
          Remove streams from StreamMap when close stream Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          77.
          Provide a default implementation for DataStreamApi.stream() Sub-task Resolved Rui Wang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          78.
          Add sync when test filestore performance Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          79.
          FileStore stream to send small packets for MappedByteBuffer and NettyFileRegion Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m
          80.
          Stream small packet for NettyFileRegion and MappedByteBuffer Sub-task Resolved Unassigned  
          81.
          FileStore write file in parallel Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          82.
          The primary server should get the other peers from the current RaftConfiguration Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          83.
          FileStore support multi disk Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          84.
          Compare the performance between DataStreamApi and AsyncApi Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          85.
          FileStore client generate files in parallel Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2.5h
          86.
          Save STREAM_CLOSE RPC call Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h
          87.
          Compare the performance between Ozone and DataStreamApi Sub-task Resolved runzhiwang  
          88.
          Support network topology Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 5h 50m
          89.
          Add route table in RaftConfiguration Sub-task Resolved runzhiwang  
          90.
          FileStore support routing table Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          91.
          Move routingTable to RaftRpcRequestProto Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          92.
          Fix duplicated StreamMap.Key Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m
          93.
          Set default primary DataStreamServer in RaftClient.Builder Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          94.
          Close DataStreamClient when close RaftClient Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          95.
          Use ClientInvocationId as key instead of StreamMap.Key Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          96.
          Fix FileStore write failed because reply out of order Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          97.
          Resource leak when decoding DataStreamReplyByteBuffer Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 20m
          98.
          Validate RoutingTable before building it Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          99.
          Compare the performance between HDFS and DataStreamApi Sub-task Resolved runzhiwang  
          100.
          Avoid parse proto for each packet Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          101.
          Support multi-client when transfer data between servers Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          102.
          Support multi-client in FileStore Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          103.
          Use async model for StreamInfo#applyToRemotes Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          104.
          Improve the used memory Sub-task Resolved runzhiwang

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          105.
          Add an optional API to StateMachine.DataStream for providing an Executor Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          106.
          NettyClientStreamRpc#ChannelInboundHandler add exceptionCaught method Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          107.
          NettyClientStreamRpc#workerGroup Can cause too much nioEventLoopGroup object Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          108.
          make client NioEventLoopGroup size configurable. Sub-task Resolved mingchao zhao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          109.
          NettyClientStreamRpc exception handling Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          110.
          Include commit infos in DataStreamReply Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          111.
          Move netty related code out from ratis-common Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          112.
          Cleanup NettyClientStreamRpc#replies empty queue Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          113.
          Fix log output in sendRequest Sub-task Resolved mingchao zhao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          114.
          The file store client will hung when streaming writes. Sub-task Resolved mingchao zhao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          115.
          Clean StreamMap when an exception occurs in DataStreamManagement#read Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          116.
          NettyServerStreamRpc get request resolving concurrency security Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 10m
          117.
          fix NettyClientStreamRpc.ChannelInboundHandler#clientInvocationId concurrency security problem Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          118.
          DataStreamManagement startTransaction error handler Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          119.
          OrderedStreamAsync error handler Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          120.
          make use CachedThreadPool configurable. Sub-task Resolved mingchao zhao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 40m
          121.
          Add request timeout to ratis Streaming Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          122.
          Use the stream level SlidingWindow.client in OrderedStreamAsync Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1.5h
          123.
          Change outstanding-requests.max default value. Sub-task Resolved mingchao zhao  
          124.
          NettyClientStreamRpc error reply handling Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 10m
          125.
          When DataStreamManagement#read an exception occurs, release ByteBuf Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 20m
          126.
          Streaming tests may fail with TimeoutIOException: Timeout 3000ms Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          127.
          NettyServerStreamRpc use EpollEventLoopGroup Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 50m
          128.
          Protocol message contained an invalid tag Sub-task Resolved Unassigned  
          129.
          Handle when there is an exception in NettyServerStreamRpc# getDataStreamOutput Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 3h 10m
          130.
          OrderedStreamAsync uses a separate of send thread pool Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 20m
          131.
          Add metric to streaming Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h
          132.
          If the stream client is abnormally disconnected, reconnect the stream client Sub-task Resolved GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 40m
          133.
          Make a new ratis snapshot version Sub-task Resolved Tsz-wo Sze  
          134.
          Support reference-counted buffer in StateMachine.DataChannel Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 1h 40m
          135.
          Discussion on improving the stability of streaming Sub-task Resolved mingchao zhao  
          136.
          Benchmark various ways to stream data Sub-task Open Unassigned  
          137.
          FileStore can support different mode of network topology through CLI Sub-task Open Rui Wang  
          138.
          Save STREAM_HEADER RPC call Sub-task Open runzhiwang  
          139.
          Buffer packets when the size of packets are too small Sub-task In Progress Unassigned  
          140.
          DataStreamManagement#checkSuccessRemoteWrite add timeout handling Sub-task Open GuoHao  
          141.
          When DataStreamManagement#read an exception occurs, remove DataStream Sub-task Patch Available GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 2h 50m
          142.
          Optional DataStreamManagement#startTransaction configuration Sub-task Patch Available GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 4h
          143.
          Hung after a long time running when streaming writes Sub-task Open GuoHao  
          144.
          Cleanup NettyClientStreamRpc#replies empty queue optimize Sub-task Patch Available GuoHao

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          145.
          Change the client timeout of stream to the server timeout Sub-task Open GuoHao  
          146.
          NettyServerStreamRpc.Proxies#getProxy NPE Sub-task Open Unassigned  
          147.
          DataStreamManagement#startTransaction prevent accidental assertion errors Sub-task Open Unassigned  
          148.
          NettyServerStreamRpc may throw NPE Sub-task Resolved Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 50m
          149.
          Move the asyncRpcApi.sendForward(..) call to the client side. Sub-task Open Tsz-wo Sze

          100%

          Original Estimate - Not Specified Original Estimate - Not Specified
          Time Spent - 0.5h
          150.
          The following assertion error occurs when transferring large files Sub-task Open Tsz-wo Sze  

          Activity

            People

              szetszwo Tsz-wo Sze
              szetszwo Tsz-wo Sze
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 229.5h
                  229.5h