[RATIS-1234] Compare the performance between Ozone and DataStreamApi

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Component/s: Streaming
• Assignee: runzhiwang
• Reporter: runzhiwang
• Created: 11/Dec/20 14:39
• Updated: 17/Dec/20 01:17
• Resolved: 17/Dec/20 01:17

Description

szetszwo Hi, my network bandwidth is only 10000Mb / s, because primary need to stream data to two peers, the max IO speed for peer is only 5000Mb / s, about 625MB / s. So I can not test the max throughput of ratis streaming and ozone cluster.

Besides, ozone has the balance leader feature, for example, if ozone cluster has 6 pipeline, 3 datanodes, each datanode has 2 leader, the 10000Mb /s can be used fully for each datanode. So with this 10000Mb / s network bandwidth, we can not compare ozone and DataStreamApi, unless we change DataStreamApi to primary -> peer -> peer, or we need machine with bigger network bandwidth, but I do not have.

Actually, I test the performance of ozone and DataStreamApi with high load, they are almost similar.