[KUDU-3132] Support RPC compression

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: perf, rpc
• Labels: performance roadmap-candidate
• Assignee: Unassigned
• Reporter: Grant Henke
• Created: 27/May/20 01:54
• Updated: 13/Jul/21 20:02

Description

I have seen more and more deployments of Kudu where the tablet servers are not co-located with the compute resources such as Impala or Spark. In deployments like this, there could be significant network savings by compressing the RPC messages (especially those that write or scan data). 

Adding simple LZ4 or Snappy compression support to the RPC messages when not on a loopback/local connection should be a great improvement for network bound applications.