Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3599

Impala should account for memory used by Thrift transport

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • Impala 2.6.0
    • None
    • Distributed Exec

    Description

      Each thrift transport uses a non-trivial amount of memory (256kb of buffers) and Impala creates a lot of them. We should track this memory in a way that we can measure and understand how much memory the RPC stack is using.

      I already prototyped a patch to track the amount of memory the thrift client cache is using, which is relatively straightforward. It will be a little hard to track the server memory, since we hand over control of the transport to thrift.

      Attachments

        Activity

          People

            Unassigned Unassigned
            tarmstrong Tim Armstrong
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: