[HDDS-10943] Freon DN Echo should skip writing payload to ratis log

• Type: Sub-task
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Labels: pull-request-available
• Assignee: Wei-Chiu Chuang
• Reporter: Wei-Chiu Chuang
• Created: 29/May/24 17:50
• Updated: 5 days ago 00:19

Description

If the --payload-req parameter is specified (sending X KB payload in the request), the entire request plus the payload is written to Ratis log, and Ratis log rapidly tails every few seconds. Assuming a 1KB payload per request and Ratis writes 16k requests per second, it takes merely 4 seconds to fill up a 64MB ratis log file.

 

Note that Ozone DataNode clears payload for WriteChunk request in ContainerStateMachine. We should do something similar for Echo request.

 

I wonder if OM Echo has similar problem.

Issue Links

• is a child of: HDDS-10755 [hsync] Investigate why DataNode Echo throughput is so low
• links to: GitHub Pull Request #6825