Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3132

Support RPC compression

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: perf, rpc

      Description

      I have seen more and more deployments of Kudu where the tablet servers are not co-located with the compute resources such as Impala or Spark. In deployments like this, there could be significant network savings by compressing the RPC messages (especially those that write or scan data). 

      Adding simple LZ4 or Snappy compression support to the RPC messages when not on a loopback/local connection should be a great improvement for network bound applications.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              granthenke Grant Henke
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: