[HDDS-10338] Implement a Client Datanode API to stream a block

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: Ozone Client, Ozone Datanode
• Labels: pull-request-available
• Assignee: Chung En Lee
• Reporter: Ritesh Shukla
• Created: 08/Feb/24 22:47
• Updated: 09/May/24 00:00

Description

To reduce round trips between the Client and Datanode for reading a block, we nee a new API to read.

Client -> block(offset, length) -> Datanode
Client <- chunkN <- Datanode
Client <- chunkN+1 <- Datanode
..
Client <-chunkLast <- Datanode

This is using the ability of gRPC to send bidirectional traffic such that the server can pipeline the chunks to the client without waiting for ReadChunk API calls. This also avoids the client from creating multiple Chunk Stream Clients and should simplify the read path on the client side by a bit.

Issue Links

• relates to: HDDS-9904 Ozone reads as data streams
• links to: GitHub Pull Request #6613