Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3599

Impala should account for memory used by Thrift transport

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: Impala 2.6.0
    • Fix Version/s: None
    • Component/s: Distributed Exec

      Description

      Each thrift transport uses a non-trivial amount of memory (256kb of buffers) and Impala creates a lot of them. We should track this memory in a way that we can measure and understand how much memory the RPC stack is using.

      I already prototyped a patch to track the amount of memory the thrift client cache is using, which is relatively straightforward. It will be a little hard to track the server memory, since we hand over control of the transport to thrift.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tarmstrong Tim Armstrong
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: