Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
Impala 2.6.0
-
None
Description
Each thrift transport uses a non-trivial amount of memory (256kb of buffers) and Impala creates a lot of them. We should track this memory in a way that we can measure and understand how much memory the RPC stack is using.
I already prototyped a patch to track the amount of memory the thrift client cache is using, which is relatively straightforward. It will be a little hard to track the server memory, since we hand over control of the transport to thrift.